00000001:02000400:0.0F:1787097983.723097:0:2965:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787098002.075028:0:3185:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787098003.910952:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 523 MB/s 00000001:01000000:3.0:1787098004.160770:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 775 MB/s 00000001:01000000:2.0F:1787098004.411785:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4717 MB/s 00000020:02000000:3.0:1787098005.118276:0:3278:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.57_1_g147bb23 00000400:02000000:1.0:1787098005.889043:0:3293:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.151@tcp [8/256/0/180] 00008000:02000000:2.0:1787098009.174102:0:3442:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787098050.860010:0:5244:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787098059.079822:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787098059.079830:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787098059.079987:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002f1f42fe 00000080:02000400:0.0:1787098059.080000:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787098059.089804:0:5825:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787098059.089819:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787098059.089963:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000001e2c191) 00000020:00000080:2.0:1787098059.089988:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787098059.103425:0:5825:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787098059.103888:0:5825:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787098059.121511:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787098059.121550:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787098059.121585:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787098059.121636:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787098059.121661:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787098059.122375:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787098059.122384:0:5825:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787098059.122395:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b0144359 00000020:01000004:3.0:1787098059.122402:0:5825:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787098059.122406:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787098059.122410:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002f1f42fe from MGS 00000020:01000004:3.0:1787098059.122416:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787098059.122440:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006af60a8e) 00000020:00000080:3.0:1787098059.122452:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787098059.122524:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f1f42fe from MGS, refs=2 00080000:01000000:3.0:1787098059.122530:0:5825:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787098059.122534:0:5825:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b0144367 00000100:00100000:3.0:1787098059.122661:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787098059.122878:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787098059.122884:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787098059.123512:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787098059.123519:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787098059.124150:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787098059.124406:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787098059.124412:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787098059.125420:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787098059.125428:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787098059.125753:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787098059.125759:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787098059.126569:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098059.126575:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098059.126576:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098059.127219:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098059.127222:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098059.127224:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098059.128264:0:5825:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787098059.131455:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787098059.378387:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3335 MB/s 00000001:01000000:0.0:1787098059.629011:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3327 MB/s 00000001:01000000:2.0:1787098059.879181:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 619 MB/s 00000001:01000000:3.0:1787098060.128679:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 839 MB/s 00080000:10000000:2.0:1787098060.134167:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787098060.147263:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787098060.147375:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787098060.147378:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787098060.147991:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787098060.148050:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787098060.148085:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787098060.148247:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787098060.148273:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787098060.148631:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098060.148783:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787098060.148790:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787098060.158804:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787098060.158834:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787098060.159191:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787098060.159199:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787098060.159845:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787098060.159866:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.151@tcp' 00000020:01000004:2.0:1787098060.159868:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787098060.159916:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.151@tcp (typ=mgc) 00000020:00000080:2.0:1787098060.159927:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.151@tcp (000000001260dbb8) 00000020:00000080:2.0:1787098060.159943:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787098060.160029:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009c8c036c@MGC192.168.204.151@tcp: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1787098060.160185:0:5825:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.151@tcp-0 is initialized 00000040:01000000:2.0:1787098060.160191:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787098060.162346:0:5840:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787098060.166195:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787098060.166971:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.151@tcp (uuid af6522d0-d61c-40bd-bd34-bb282ba82d15) 00000020:00000080:2.0:1787098060.166997:0:5825:0:(genops.c:1406:class_connect()) connect: client af6522d0-d61c-40bd-bd34-bb282ba82d15, cookie 0xb1d871f9b0144375 00000100:00080000:2.0:1787098060.167012:0:5825:0:(import.c:510:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787098060.167017:0:5825:0:(import.c:624:import_select_connection()) MGC192.168.204.151@tcp: import 000000009c8c036c using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1787098060.167070:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005df15522 x1873908077691008/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787098060.167098:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import af6522d0-d61c-40bd-bd34-bb282ba82d15->MGS 00000020:01000004:2.0:1787098060.167116:0:5825:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787098060.167121:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787098060.167134:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b6e5533f) 00000020:00000080:2.0:1787098060.167147:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787098060.169117:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005df15522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:af6522d0-d61c-40bd-bd34-bb282ba82d15:3308:1873908077691008:0@lo:250: 00000100:00100000:3.0:1787098060.169248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098060.170203:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077691008 00000100:00100000:0.0:1787098060.170214:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077691008 00000100:00100000:0.0:1787098060.170273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787098060.170293:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b16f307a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1873908077691008:12345-0@lo:250: 00010000:00080000:0.0:1787098060.170329:0:5836:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from af6522d0-d61c-40bd-bd34-bb282ba82d15@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:0.0:1787098060.170488:0:5836:0:(genops.c:1406:class_connect()) connect: client af6522d0-d61c-40bd-bd34-bb282ba82d15, cookie 0xb1d871f9b0144383 00000100:00080000:0.0:1787098060.170770:0:5836:0:(import.c:65:import_set_state_nolock()) 0000000043efe822 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098060.170915:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b16f307a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:3308:x1873908077691008:12345-0@lo:250: Request processed in 633us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098060.170923:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098060.174846:0:3308:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787098060.174865:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.151@tcp: connect to target with instance 0 00000100:00080000:3.0:1787098060.174875:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787098060.174883:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787098060.174899:0:3308:0:(import.c:65:import_set_state_nolock()) 000000009c8c036c MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787098060.174904:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787098060.174927:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787098060.174937:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005df15522 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:af6522d0-d61c-40bd-bd34-bb282ba82d15:3308:1873908077691008:0@lo:250: 00010000:00010000:0.0:1787098060.177808:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098060.181371:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098060.182960:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787098060.182967:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787098060.185944:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787098060.185960:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787098060.186532:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787098060.186551:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787098060.187779:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098060.187984:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787098060.187990:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787098060.191565:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787098060.191589:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787098060.252763:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787098060.253148:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787098060.253156:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787098060.261630:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787098060.261966:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787098060.264117:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098060.265590:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787098060.265601:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787098060.266966:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787098060.266978:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787098060.273564:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098060.273777:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787098060.273784:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787098060.275570:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787098060.275587:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787098060.276213:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098060.276531:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787098060.276548:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787098060.277077:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787098060.277084:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787098060.320156:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787098060.321190:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787098060.321199:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787098060.323669:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787098060.323683:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787098060.325230:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787098060.325243:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787098060.326222:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787098060.326247:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787098060.326254:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787098060.326596:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787098060.326635:0:5825:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787098060.326640:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787098060.326642:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787098060.326644:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098060.326645:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787098060.326646:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098060.326647:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098060.326648:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787098060.326650:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787098060.326651:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787098060.326652:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787098060.326654:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098060.326660:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787098060.326662:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787098060.326664:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787098060.326665:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787098060.326666:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098060.326667:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787098060.326668:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098060.326669:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098060.326670:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787098060.326670:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787098060.326671:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787098060.326672:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787098060.326673:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098060.326674:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787098060.326709:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787098060.326729:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9ca11d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691136:0@lo:253: 00000100:00100000:1.0:1787098060.326810:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098060.326919:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 0000000090007a5b going to sleep for 11 seconds 00000100:00100000:0.0:1787098060.327072:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077691136 00000100:00100000:0.0:1787098060.327080:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077691136 00000100:00100000:0.0:1787098060.327164:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787098060.327173:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081396468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:5825:x1873908077691136:12345-0@lo:253: 20000000:01000000:0.0:1787098060.327226:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787098060.327230:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787098060.327568:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787098060.327632:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787098060.328009:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787098060.328978:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787098060.329252:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787098060.329257:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787098060.329262:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787098060.329265:0:5839:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787098060.329318:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787098060.329517:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787098060.329738:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787098060.329751:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787098060.329801:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787098060.329851:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787098060.329892:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787098060.330147:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787098060.330155:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787098060.330214:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787098060.330222:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787098060.330251:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787098060.330257:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787098060.330521:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787098060.330595:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787098060.330634:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787098060.330640:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787098060.330656:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787098060.330841:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787098060.330859:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787098060.330897:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787098060.331130:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787098060.331186:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787098060.331199:0:5839:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787098060.331394:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787098060.331405:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787098060.331459:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787098060.331499:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787098060.331549:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787098060.331562:0:5839:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787098060.331664:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787098060.331674:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787098060.331710:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787098060.331748:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787098060.331915:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787098060.332050:0:5839:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787098060.332057:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787098060.332586:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787098060.332886:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787098060.332909:0:5839:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.151@tcp for mdt 20000000:01000000:0.0:1787098060.332911:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:0.0:1787098060.333034:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787098060.333042:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787098060.333074:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787098060.333082:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:0.0:1787098060.333124:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787098060.333134:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787098060.333167:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787098060.333203:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787098060.333266:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787098060.333269:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787098060.333500:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787098060.333599:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787098060.333603:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787098060.333637:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787098060.333639:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787098060.334125:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787098060.334424:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787098060.334472:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787098060.334511:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787098060.334522:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787098060.334524:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787098060.335126:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787098060.335551:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787098060.335598:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787098060.335681:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1787098060.335698:0:5839:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787098060.335701:0:5839:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787098060.335706:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787098060.335709:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787098060.335713:0:5839:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787098060.335721:0:5839:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787098060.336113:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787098060.336234:0:5839:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787098060.346496:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787098060.346569:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787098060.347089:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787098060.347117:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787098060.347142:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347160:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347170:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347175:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347198:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347204:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347209:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb3b346a already unused, calling callback (00000000e67fea98) 00010000:00010000:2.0:1787098060.347212:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347218:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347229:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347235:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.347240:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb3b346a/0xb1d871f9b014438a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787098060.347261:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787098060.608085:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081396468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:5825:x1873908077691136:12345-0@lo:253: Request processed in 280904us (281266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098060.608103:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787098060.608215:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9ca11d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691136:0@lo:253: 10000000:01000000:1.0:1787098060.608231:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787098060.608234:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787098060.608236:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787098060.608237:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098060.608239:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787098060.608253:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098060.608255:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098060.608256:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787098060.608257:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787098060.608259:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787098060.608260:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098060.608261:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787098060.608302:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002f1f42fe from lustre-MDT0000 10000000:01000000:1.0:1787098060.608328:0:5825:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787098060.608331:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787098060.608335:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d7208e14d40 10000000:01000000:1.0:1787098060.608339:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787098060.608347:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d7208e14d40 from 1 10000000:01000000:1.0:1787098060.608350:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787098060.608388:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000013128a3e/0xb1d871f9b0144391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.608399:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000013128a3e/0xb1d871f9b0144391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.608406:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000013128a3e/0xb1d871f9b0144391 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098060.608426:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f9ca11d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691264:0@lo:101: 00000100:00100000:1.0:1787098060.608461:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098060.608575:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054ad0e2a going to sleep for 11 seconds 00000100:00100000:0.0:1787098060.608633:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077691264 00000100:00100000:0.0:1787098060.608758:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077691264 00000100:00100000:0.0:1787098060.608803:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098060.608811:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000674e3f96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:5825:x1873908077691264:12345-0@lo:101: 00010000:00010000:0.0:1787098060.608825:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098060.608840:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009aa71ab0/0xb1d871f9b0144398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144391 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098060.608862:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009aa71ab0/0xb1d871f9b0144398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144391 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098060.608871:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009aa71ab0/0xb1d871f9b0144398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144391 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098060.608880:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009aa71ab0, rc 0) 00000100:00100000:0.0:1787098060.608915:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000674e3f96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+6:5825:x1873908077691264:12345-0@lo:101: Request processed in 105us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098060.608921:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787098060.609032:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f9ca11d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691264:0@lo:101: 00010000:00010000:2.0:1787098060.609045:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000013128a3e/0xb1d871f9b0144391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098060.609053:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000013128a3e/0xb1d871f9b0144391 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098060.609113:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b27bab92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691392:0@lo:501: 00000100:00100000:2.0:1787098060.609154:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098060.609218:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000008eb33c8b going to sleep for 11 seconds 00000100:00100000:0.0:1787098060.609399:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077691392 00000100:00100000:0.0:1787098060.609404:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077691392 00000100:00100000:2.0:1787098060.609561:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787098060.609568:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e85c77d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+6:5825:x1873908077691392:12345-0@lo:501: 00000100:00100000:2.0:1787098060.609910:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e85c77d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+6:5825:x1873908077691392:12345-0@lo:501: Request processed in 342us (756us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787098060.609917:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787098060.610001:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b27bab92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691392:0@lo:501: 10000000:01000000:1.0:1787098060.610027:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787098060.610049:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000013128a3e/0xb1d871f9b0144391 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.610058:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000013128a3e/0xb1d871f9b0144391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098060.610073:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d72079cb000 10000000:01000000:1.0:1787098060.610079:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787098060.610083:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d72079cb000 10000000:01000000:1.0:1787098060.610086:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787098060.610088:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d72079cb000 from 1 10000000:01000000:1.0:1787098060.610091:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787098060.610111:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000972d8812/0xb1d871f9b014439f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.610118:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000972d8812/0xb1d871f9b014439f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.610126:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000972d8812/0xb1d871f9b014439f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098060.610139:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691520:0@lo:101: 00000100:00100000:1.0:1787098060.610167:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098060.610470:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000004761d446 going to sleep for 11 seconds 00000100:00100000:0.0:1787098060.610547:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077691520 00000100:00100000:0.0:1787098060.610552:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077691520 00000100:00100000:0.0:1787098060.610576:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787098060.610581:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000525f6cf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+6:5825:x1873908077691520:12345-0@lo:101: 00010000:00010000:0.0:1787098060.610591:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098060.610602:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003dca95bc/0xb1d871f9b01443a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014439f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098060.610627:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003dca95bc/0xb1d871f9b01443a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014439f expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098060.610745:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003dca95bc/0xb1d871f9b01443a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014439f expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098060.610754:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003dca95bc, rc 0) 00000100:00100000:0.0:1787098060.610794:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000525f6cf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+7:5825:x1873908077691520:12345-0@lo:101: Request processed in 212us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098060.610800:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787098060.610878:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691520:0@lo:101: 00010000:00010000:1.0:1787098060.610891:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000972d8812/0xb1d871f9b014439f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.610900:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000972d8812/0xb1d871f9b014439f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098060.610914:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787098060.610923:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000972d8812/0xb1d871f9b014439f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.610940:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000972d8812/0xb1d871f9b014439f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098060.610947:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787098060.610950:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787098060.610955:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d72079cb000 10000000:01000000:1.0:1787098060.610957:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787098060.610960:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787098060.610962:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787098060.610978:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000003214ed0f/0xb1d871f9b01443ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.610983:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000003214ed0f/0xb1d871f9b01443ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.610989:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000003214ed0f/0xb1d871f9b01443ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098060.611000:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691648:0@lo:101: 00000100:00100000:1.0:1787098060.611024:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098060.611045:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000004761d446 going to sleep for 11 seconds 00000100:00100000:0.0:1787098060.611098:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077691648 00000100:00100000:0.0:1787098060.611103:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077691648 00000100:00100000:0.0:1787098060.611121:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787098060.611127:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016ba67bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+7:5825:x1873908077691648:12345-0@lo:101: 00010000:00010000:0.0:1787098060.611134:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098060.611142:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a92db64c/0xb1d871f9b01443b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01443ad expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098060.611154:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a92db64c/0xb1d871f9b01443b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01443ad expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098060.611161:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a92db64c/0xb1d871f9b01443b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01443ad expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098060.611167:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a92db64c, rc 0) 00000100:00100000:0.0:1787098060.611203:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016ba67bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+8:5825:x1873908077691648:12345-0@lo:101: Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098060.611210:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787098060.611297:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691648:0@lo:101: 00010000:00010000:1.0:1787098060.611307:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000003214ed0f/0xb1d871f9b01443ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098060.611314:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000003214ed0f/0xb1d871f9b01443ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098060.611367:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691776:0@lo:501: 00000100:00100000:1.0:1787098060.611391:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098060.611410:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000004761d446 going to sleep for 11 seconds 00000100:00100000:0.0:1787098060.611463:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077691776 00000100:00100000:0.0:1787098060.611467:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077691776 00000100:00100000:0.0:1787098060.611485:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787098060.611490:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000071d64dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+8:5825:x1873908077691776:12345-0@lo:501: 00000100:00100000:0.0:1787098060.611894:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000071d64dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:5825:x1873908077691776:12345-0@lo:501: Request processed in 403us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098060.611901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787098060.612081:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691776:0@lo:501: 00000100:00100000:1.0:1787098060.612111:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691904:0@lo:503: 00000100:00100000:1.0:1787098060.612147:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098060.612211:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000004761d446 going to sleep for 11 seconds 00000100:00100000:3.0:1787098060.612240:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077691904 00000100:00100000:3.0:1787098060.612244:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077691904 00000100:00100000:0.0:1787098060.612301:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787098060.612308:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c322289e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:5825:x1873908077691904:12345-0@lo:503: 00000100:00100000:0.0:1787098060.612453:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c322289e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:5825:x1873908077691904:12345-0@lo:503: Request processed in 147us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098060.612459:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787098060.612542:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077691904:0@lo:503: 00000100:00100000:1.0:1787098060.613099:0:5867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:5867:1873908077692032:0@lo:502: 00000100:00100000:1.0:1787098060.613140:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098060.613170:0:5867:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a8a7a468 going to sleep for 11 seconds 00000100:00100000:2.0:1787098060.613225:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077692032 00000100:00100000:2.0:1787098060.613231:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077692032 00000100:00100000:2.0:1787098060.613265:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787098060.613272:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b7bbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:5867:x1873908077692032:12345-0@lo:502: 00000100:00100000:2.0:1787098060.613458:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b7bbc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:5867:x1873908077692032:12345-0@lo:502: Request processed in 186us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098060.613465:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787098060.613551:0:5867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:5867:1873908077692032:0@lo:502: 00000020:01000000:1.0:1787098060.613572:0:5867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098060.613583:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098060.613585:0:5867:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787098060.613590:0:5867:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787098060.613593:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787098060.613614:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001a7f0792) 00000020:00000080:1.0:1787098060.613630:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787098060.613758:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787098060.613864:0:5867:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787098060.613872:0:5867:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b01443c2 00000020:00000080:1.0:1787098060.614087:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787098060.614092:0:5867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098060.614096:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098060.614102:0:5867:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787098060.614105:0:5867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098060.614108:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098060.614109:0:5867:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787098060.614112:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787098060.614118:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000079b4f6b9) 00000020:00000080:1.0:1787098060.614126:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787098060.614129:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787098060.614131:0:5867:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787098060.614133:0:5867:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787098060.614138:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787098060.614185:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f1f42fe from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787098060.614197:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000bb76af83) 00000020:00000080:1.0:1787098060.614204:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787098060.614250:0:5867:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787098060.614263:0:5867:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b01443d7 00000020:00000080:1.0:1787098060.614430:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787098060.614436:0:5867:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787098060.614441:0:5867:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb1d871f9b01443de 00080000:01000000:1.0:1787098060.614445:0:5867:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787098060.614449:0:5867:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b01443e5 00080000:10000000:1.0:1787098060.615067:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787098060.615267:0:5867:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787098060.621799:0:5867:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787098060.761235:0:5867:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787098060.763111:0:5867:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787098060.770375:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787098060.770780:0:5867:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787098060.893598:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c4defe16) 00000020:00000080:1.0:1787098060.893623:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787098060.893710:0:5867:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787098060.893718:0:5867:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b01443f3 00000020:00000080:1.0:1787098060.894130:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787098060.903454:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098060.956316:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098060.989560:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098061.021013:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098061.062246:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787098061.101586:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787098061.157025:0:5867:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb1d871f9b01443fa 00000020:00000080:3.0:1787098061.158955:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787098061.158976:0:5867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787098061.158986:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098061.158989:0:5867:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787098061.158992:0:5867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787098061.158997:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098061.158998:0:5867:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787098061.159001:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787098061.159003:0:5867:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787098061.159005:0:5867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787098061.159007:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098061.159008:0:5867:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787098061.159010:0:5867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787098061.159015:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098061.159016:0:5867:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787098061.159019:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787098061.159072:0:5867:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787098061.159205:0:5867:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e06cb3b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:5867:1873908077692160:0@lo:502: 00000100:00100000:3.0:1787098061.159341:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098061.159414:0:5867:0:(client.c:2702:ptlrpc_set_wait()) set 0000000025a6bb2a going to sleep for 11 seconds 00000100:00100000:2.0:1787098061.160848:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077692160 00000100:00100000:2.0:1787098061.160864:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077692160 00000100:00100000:2.0:1787098061.160940:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787098061.160950:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003894b70b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:5867:x1873908077692160:12345-0@lo:502: 00000100:00100000:2.0:1787098061.161416:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003894b70b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:5867:x1873908077692160:12345-0@lo:502: Request processed in 468us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098061.161431:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787098061.161902:0:5867:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e06cb3b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:5867:1873908077692160:0@lo:502: 00000020:01000000:0.0:1787098061.161940:0:5867:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098061.161948:0:5867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098061.161950:0:5867:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787098061.161954:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787098061.162728:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787098061.162830:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787098061.162852:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000003214ed0f/0xb1d871f9b01443ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098061.162865:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000003214ed0f/0xb1d871f9b01443ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098061.162872:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d72079cb000 from 1 10000000:01000000:2.0:1787098061.162875:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787098061.162915:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098061.162922:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098061.162930:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098061.162951:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003d51613a pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692288:0@lo:101: 00000100:00100000:2.0:1787098061.163007:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098061.164856:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d4da1e4e going to sleep for 11 seconds 00000100:00100000:1.0:1787098061.170004:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077692288 00000100:00100000:1.0:1787098061.170021:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077692288 00000100:00100000:1.0:1787098061.170153:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787098061.170162:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a651c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:5825:x1873908077692288:12345-0@lo:101: 00010000:00010000:1.0:1787098061.170182:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098061.170203:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144401 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098061.170228:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144401 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098061.170238:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144401 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098061.170246:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd0a50f1, rc 0) 00000100:00100000:1.0:1787098061.170349:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a651c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:5825:x1873908077692288:12345-0@lo:101: Request processed in 188us (7341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098061.170356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787098061.170549:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003d51613a pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692288:0@lo:101: 00010000:00010000:0.0:1787098061.170567:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.170576:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098061.171361:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692416:0@lo:256: 00000100:00100000:0.0:1787098061.171413:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098061.171599:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000007cab30b9 going to sleep for 11 seconds 00000100:00100000:1.0:1787098061.171670:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077692416 00000100:00100000:1.0:1787098061.171676:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077692416 00000100:00100000:1.0:1787098061.171913:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787098061.171922:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008973b0e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:5825:x1873908077692416:12345-0@lo:256: 20000000:01000000:1.0:1787098061.171940:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787098061.171946:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787098061.172026:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008973b0e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:5825:x1873908077692416:12345-0@lo:256: Request processed in 105us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098061.172034:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787098061.172096:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692416:0@lo:256: 10000000:01000000:0.0:1787098061.172929:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787098061.172947:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.172958:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098061.172967:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d72079cb000 from 1 10000000:01000000:0.0:1787098061.172970:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787098061.173009:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.173017:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.173026:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098061.173047:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692544:0@lo:101: 00000100:00100000:0.0:1787098061.173099:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098061.173376:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000007cab30b9 going to sleep for 11 seconds 00000100:00100000:2.0:1787098061.173462:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077692544 00000100:00100000:2.0:1787098061.173468:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077692544 00000100:00100000:2.0:1787098061.173503:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787098061.173510:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081dedb12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:5825:x1873908077692544:12345-0@lo:101: 00010000:00010000:2.0:1787098061.173534:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098061.173557:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014440f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098061.173577:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014440f expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098061.173586:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014440f expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098061.173594:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009942dde7, rc 0) 00000100:00100000:2.0:1787098061.173735:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081dedb12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:5825:x1873908077692544:12345-0@lo:101: Request processed in 225us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098061.173742:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787098061.173957:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692544:0@lo:101: 00010000:00010000:0.0:1787098061.173970:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.173983:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098061.174038:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692672:0@lo:501: 00000100:00100000:0.0:1787098061.174066:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098061.174126:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000007cab30b9 going to sleep for 11 seconds 00000100:00100000:2.0:1787098061.174156:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077692672 00000100:00100000:2.0:1787098061.174160:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077692672 00000100:00100000:2.0:1787098061.174222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787098061.174229:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000394a7547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:5825:x1873908077692672:12345-0@lo:501: 00000100:00100000:3.0:1787098061.175190:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000394a7547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:5825:x1873908077692672:12345-0@lo:501: Request processed in 959us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098061.175208:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787098061.175311:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692672:0@lo:501: 00000100:00100000:0.0:1787098061.175350:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692800:0@lo:503: 00000100:00100000:0.0:1787098061.175393:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098061.175415:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077692800 00000100:00100000:3.0:1787098061.175420:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077692800 00000100:00100000:0.0:1787098061.175428:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 000000007cab30b9 going to sleep for 11 seconds 00000100:00100000:3.0:1787098061.175458:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787098061.175465:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000478f6ecd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:5825:x1873908077692800:12345-0@lo:503: 00000040:00080000:3.0:1787098061.175500:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787098061.175560:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000478f6ecd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:5825:x1873908077692800:12345-0@lo:503: Request processed in 97us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098061.175567:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787098061.175577:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692800:0@lo:503: 00000040:00080000:3.0:1787098061.176560:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787098061.176726:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787098061.176746:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787098061.176766:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.176778:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098061.176826:0:5825:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787098061.176829:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d72079cb000 10000000:01000000:0.0:1787098061.176833:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d72079cb000 10000000:01000000:0.0:1787098061.176836:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787098061.176842:0:5825:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d72079cb000 from 1 10000000:01000000:0.0:1787098061.176845:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787098061.176884:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000013509c86/0xb1d871f9b014441d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.176903:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000013509c86/0xb1d871f9b014441d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.176913:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000013509c86/0xb1d871f9b014441d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098061.176930:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692928:0@lo:101: 00000100:00100000:0.0:1787098061.176974:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098061.177010:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000471b4c85 going to sleep for 11 seconds 00000100:00100000:2.0:1787098061.177211:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077692928 00000100:00100000:2.0:1787098061.177217:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077692928 00000100:00100000:2.0:1787098061.177259:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787098061.177266:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059318aef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:5825:x1873908077692928:12345-0@lo:101: 00010000:00010000:2.0:1787098061.177455:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098061.177549:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000554f8dbb/0xb1d871f9b0144424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014441d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.177572:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000554f8dbb/0xb1d871f9b0144424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014441d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.177581:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000554f8dbb/0xb1d871f9b0144424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014441d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.177589:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000554f8dbb, rc 0) 00000100:00100000:3.0:1787098061.177635:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059318aef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5825:x1873908077692928:12345-0@lo:101: Request processed in 369us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098061.177641:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787098061.177711:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077692928:0@lo:101: 00010000:00010000:0.0:1787098061.177723:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000013509c86/0xb1d871f9b014441d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.177730:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000013509c86/0xb1d871f9b014441d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098061.177776:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077693056:0@lo:501: 00000100:00100000:0.0:1787098061.177801:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098061.177858:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000471b4c85 going to sleep for 11 seconds 00000100:00100000:3.0:1787098061.177934:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077693056 00000100:00100000:3.0:1787098061.177938:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077693056 00000100:00100000:3.0:1787098061.177966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787098061.177972:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8f2d7db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5825:x1873908077693056:12345-0@lo:501: 00000100:00100000:3.0:1787098061.178412:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8f2d7db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5825:x1873908077693056:12345-0@lo:501: Request processed in 439us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098061.178427:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787098061.178491:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077693056:0@lo:501: 00000100:00100000:0.0:1787098061.178536:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077693184:0@lo:503: 00000100:00100000:0.0:1787098061.178575:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098061.178602:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000471b4c85 going to sleep for 11 seconds 00000100:00100000:3.0:1787098061.178605:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077693184 00000100:00100000:3.0:1787098061.178608:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077693184 00000100:00100000:3.0:1787098061.178637:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787098061.178642:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b76f06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5825:x1873908077693184:12345-0@lo:503: 00000100:00100000:3.0:1787098061.178951:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b76f06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5825:x1873908077693184:12345-0@lo:503: Request processed in 308us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098061.178959:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787098061.179106:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077693184:0@lo:503: 00000100:00100000:3.0:1787098061.179620:0:5872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e28b44cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:5872:1873908077693312:0@lo:502: 00000100:00100000:3.0:1787098061.179664:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098061.179736:0:5872:0:(client.c:2702:ptlrpc_set_wait()) set 0000000025a6bb2a going to sleep for 11 seconds 00000100:00100000:1.0:1787098061.179770:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077693312 00000100:00100000:1.0:1787098061.179776:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077693312 00000100:00100000:1.0:1787098061.179839:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787098061.179846:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000037a225a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5872:x1873908077693312:12345-0@lo:502: 00000100:00100000:1.0:1787098061.180168:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000037a225a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5872:x1873908077693312:12345-0@lo:502: Request processed in 322us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098061.180175:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787098061.180255:0:5872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e28b44cb pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:5872:1873908077693312:0@lo:502: 00000020:01000004:0.0:1787098061.180367:0:5872:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787098061.180391:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000902139a5) 00000020:00000080:0.0:1787098061.180416:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787098061.180712:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002f1f42fe from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787098061.180717:0:5872:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002f1f42fe from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787098061.180719:0:5872:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002f1f42fe 4 00010000:00080000:0.0:1787098061.180747:0:5872:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e62d24fa@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1787098061.186456:0:5872:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787098061.186606:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787098061.186641:0:5872:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787098061.186653:0:5872:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb1d871f9b0144432 00000100:00080000:0.0:1787098061.186663:0:5872:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787098061.186669:0:5872:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e62d24fa using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1787098061.186705:0:5872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000355c8b4f x1873908077693440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787098061.186729:0:5872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787098061.187814:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077693440:0@lo:38: 00000100:00100000:3.0:1787098061.187912:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098061.188065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077693440 00000100:00100000:0.0:1787098061.188072:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077693440 00000100:00100000:0.0:1787098061.188107:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787098061.188113:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000190a4f07 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1873908077693440:12345-0@lo:38: 00000100:00100000:0.0:1787098061.188182:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000190a4f07 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1873908077693440:12345-0@lo:38: Request processed in 67us (269us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787098061.188190:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098061.189471:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787098061.189481:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000e62d24fa lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787098061.189487:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787098061.189490:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000355c8b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077693440:0@lo:38: 00000100:00100000:0.0:1787098061.189692:0:5872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f4f76a0c pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:5872:1873908077693568:0@lo:502: 00000100:00100000:0.0:1787098061.189753:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098061.189789:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077693568 00000100:00100000:0.0:1787098061.189793:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077693568 00000100:00100000:0.0:1787098061.189826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787098061.189838:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b80c2081 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5872:x1873908077693568:12345-0@lo:502: 00000100:00100000:0.0:1787098061.190044:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b80c2081 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5872:x1873908077693568:12345-0@lo:502: Request processed in 206us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098061.190052:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787098061.190095:0:5872:0:(client.c:2702:ptlrpc_set_wait()) set 0000000063205616 going to sleep for 11 seconds 00000100:00100000:0.0:1787098061.190108:0:5872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f4f76a0c pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:5872:1873908077693568:0@lo:502: 00000040:00080000:0.0:1787098061.190127:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787098061.193904:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787098061.193937:0:5825:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787098061.193963:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000013509c86/0xb1d871f9b014441d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098061.193977:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000013509c86/0xb1d871f9b014441d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787098061.194584:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787098061.194587:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787098061.194589:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098061.194590:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787098061.194592:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098061.194594:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098061.194596:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787098061.194598:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787098061.194599:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787098061.194601:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787098061.194602:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098061.194604:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787098061.194608:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787098061.194611:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787098061.194612:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787098061.194613:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098061.194614:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787098061.194615:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098061.194616:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098061.194617:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787098061.194618:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787098061.194619:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787098061.194620:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787098061.194620:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098061.194639:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787098061.194680:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787098061.194701:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077693696:0@lo:253: 00000100:00100000:1.0:1787098061.194917:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098061.194973:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a632e588 going to sleep for 11 seconds 00000100:00100000:2.0:1787098061.195339:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077693696 00000100:00100000:2.0:1787098061.195348:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077693696 00000100:00100000:2.0:1787098061.195410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787098061.195419:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5bf475f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5825:x1873908077693696:12345-0@lo:253: 20000000:01000000:2.0:1787098061.195450:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787098061.195464:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1787098061.209433:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1787098061.253967:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787098061.253989:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787098061.254047:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787098061.254052:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787098061.254076:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.254098:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144401 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.254105:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.254147:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144401 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098061.254162:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144401 expref: 12 pid: 5839 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098061.254178:0:5859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f4f76a0c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1873908077693824:0@lo:104: 00000100:00100000:0.0:1787098061.254250:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098061.254359:0:5859:0:(client.c:2702:ptlrpc_set_wait()) set 000000007cab30b9 going to sleep for 11 seconds 00000100:00100000:3.0:1787098061.254731:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077693824 00000100:00100000:3.0:1787098061.254739:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077693824 00000100:00100000:3.0:1787098061.254802:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098061.254811:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e19f9265 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5859:x1873908077693824:12345-0@lo:104: 00010000:00010000:3.0:1787098061.254824:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.254901:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098061.254907:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e19f9265 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5859:x1873908077693824:12345-0@lo:104: Request processed in 98us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098061.254914:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787098061.254938:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098061.254944:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.254951:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb3b346a already unused, calling callback (00000000724d538e) 10000000:00010000:3.0:1787098061.254954:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.254961:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098061.254967:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098061.254972:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787098061.255001:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255007:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098061.255021:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255027:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 00000000eb3b346a/0xb1d871f9b0144401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144408 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255057:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098061.255058:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098061.255060:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098061.255117:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000051148838 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077693952:0@lo:103: 00000100:00100000:3.0:1787098061.255146:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098061.255216:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077693952 00000100:00100000:3.0:1787098061.255220:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077693952 00010000:00010000:3.0:1787098061.255236:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144401 expref: 13 pid: 5839 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098061.255254:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098061.255260:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c802db3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:3310:x1873908077693952:12345-0@lo:103: 00010000:00010000:3.0:1787098061.255269:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098061.255273:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144401 expref: 13 pid: 5839 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255312:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144401 expref: 13 pid: 5839 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255327:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255333:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787098061.255346:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001294412s 00010000:00010000:3.0:1787098061.255349:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255363:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255368:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255372:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255377:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000945a2b77 already unused, calling callback (00000000e67fea98) 00010000:00010000:3.0:1787098061.255381:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255387:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255393:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255401:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098061.255427:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c802db3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:3310:x1873908077693952:12345-0@lo:103: Request processed in 169us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098061.255434:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098061.255466:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000051148838 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077693952:0@lo:103: 00010000:00010000:3.0:1787098061.255492:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144401 expref: 12 pid: 5839 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098061.255501:0:5859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f4f76a0c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1873908077693824:0@lo:104: 00010000:00010000:3.0:1787098061.255514:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255540:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255545:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098061.255550:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000945a2b77/0xb1d871f9b0144439 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098061.266008:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5bf475f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:5825:x1873908077693696:12345-0@lo:253: Request processed in 70583us (71089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098061.266026:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787098061.266271:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e4bd53d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:5825:1873908077693696:0@lo:253: 10000000:01000000:0.0:1787098061.266317:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787098061.266336:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787098061.266338:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787098061.266340:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098061.266341:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098061.266343:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098061.266344:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098061.266345:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787098061.266347:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787098061.266348:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787098061.266350:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787098061.266351:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098061.266353:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787098061.266371:0:5825:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787098061.276443:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098061.277019:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787098061.277333:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098061.277507:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787098061.277949:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098061.278322:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787098061.280186:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098061.280429:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787098061.280710:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098061.280975:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787098061.281239:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098061.281555:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787098061.363975:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787098061.406573:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787098061.407046:0:5878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1787098061.413952:0:5877:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787098061.413962:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787098061.421109:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787098061.421476:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787098061.422044:0:5825:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787098061.422052:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787098061.422205:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787098061.428173:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787098061.428985:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787098061.429028:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787098061.429328:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787098061.429503:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787098061.433945:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787098061.434081:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787098061.434227:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787098061.434396:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787098061.434568:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787098061.436376:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787098061.436579:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787098061.436733:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787098061.437092:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787098061.437245:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787098061.437440:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787098061.437583:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787098061.437919:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787098061.438042:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787098061.438195:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787098061.438382:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787098061.438978:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787098061.439130:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787098061.439329:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787098061.439505:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787098061.440071:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787098061.440211:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787098061.440395:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787098061.440526:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787098061.440848:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787098061.440971:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787098061.441148:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787098061.441313:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787098061.441464:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787098061.442038:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787098061.442203:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787098061.442395:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787098061.443049:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787098061.471334:0:5878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787098061.525368:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787098061.525411:0:5825:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa82381d9b988 00100000:10000000:0.0:1787098061.525431:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787098061.527198:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787098061.527216:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787098061.527230:0:5825:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787098061.527247:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787098061.614636:0:5878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787098061.614710:0:5878:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787098061.614715:0:5878:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787098062.226573:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098063.249946:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098064.271697:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098065.295432:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787098065.303181:0:6120:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787098066.321662:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787098066.576458:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787098066.576465:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d72079cb000 from 3 10000000:01000000:2.0:1787098066.576470:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787098066.576514:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000030447c77/0xb1d871f9b0144440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098066.576732:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000030447c77/0xb1d871f9b0144440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098066.576745:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000030447c77/0xb1d871f9b0144440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098066.576771:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eee4da14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077694080:0@lo:101: 00000100:00100000:2.0:1787098066.576848:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098066.576945:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set 000000004924b354 going to sleep for 11 seconds 00000100:00100000:1.0:1787098066.581483:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077694080 00000100:00100000:1.0:1787098066.581499:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077694080 00000100:00100000:1.0:1787098066.581721:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787098066.581730:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000160314f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:5841:x1873908077694080:12345-0@lo:101: 00010000:00010000:1.0:1787098066.581748:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098066.581768:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005460f54e/0xb1d871f9b0144447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144440 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098066.581795:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005460f54e/0xb1d871f9b0144447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144440 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098066.581817:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005460f54e/0xb1d871f9b0144447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144440 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098066.581825:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005460f54e, rc 0) 00000100:00100000:1.0:1787098066.581900:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000160314f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077694080:12345-0@lo:101: Request processed in 171us (5051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098066.581906:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787098066.581971:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eee4da14 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077694080:0@lo:101: 00010000:00010000:1.0:1787098066.581987:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000030447c77/0xb1d871f9b0144440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098066.581996:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000030447c77/0xb1d871f9b0144440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098066.582056:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb84d47d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077694208:0@lo:256: 00000100:00100000:1.0:1787098066.582096:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098066.582128:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set 000000006d84b06f going to sleep for 11 seconds 00000100:00100000:1.0:1787098066.582142:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077694208 00000100:00100000:1.0:1787098066.582145:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077694208 00000100:00100000:1.0:1787098066.582166:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787098066.582172:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079d23e35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077694208:12345-0@lo:256: 20000000:01000000:1.0:1787098066.582185:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787098066.582200:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787098066.582203:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787098066.582270:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079d23e35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077694208:12345-0@lo:256: Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098066.582659:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787098066.582701:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb84d47d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077694208:0@lo:256: 10000000:01000000:1.0:1787098066.582739:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787098066.582746:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000030447c77/0xb1d871f9b0144440 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098066.582753:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000030447c77/0xb1d871f9b0144440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787098066.584865:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787098066.584874:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787098066.584878:0:8:0:(import.c:65:import_set_state_nolock()) 00000000e62d24fa lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787098066.584889:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e62d24fa using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1787098066.584923:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bb84d47d x1873908077694336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787098066.585023:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bb84d47d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077694336:0@lo:38: 00000100:00100000:2.0:1787098066.585148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098066.585252:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077694336 00000100:00100000:0.0:1787098066.585261:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077694336 00000100:00100000:0.0:1787098066.585489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787098066.585495:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc1f8072 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1873908077694336:12345-0@lo:38: 00010000:00080000:0.0:1787098066.585519:0:5845:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:0.0:1787098066.585676:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb1d871f9b014444e 00000004:00100000:0.0:1787098066.585723:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787098066.585834:0:5845:0:(import.c:65:import_set_state_nolock()) 00000000abf0b324 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098066.585899:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc1f8072 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873908077694336:12345-0@lo:38: Request processed in 403us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098066.585906:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787098066.586147:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bb84d47d x1873908077694336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787098076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787098066.586164:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787098066.586170:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787098066.586174:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787098066.586177:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000e62d24fa lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787098066.586182:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bb84d47d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077694336:0@lo:38: 00010000:00010000:0.0:1787098067.343897:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098068.367678:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098069.391397:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787098069.566937:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2051bc40 20000000:00000080:1.0:1787098069.566956:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d723b2f9000 uarg=0000000000000000 20000000:01000000:1.0:1787098069.566992:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787098069.567000:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787098069.567005:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787098069.567253:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787098069.567635:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787098069.571005:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787098069.571494:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787098069.571551:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787098069.571593:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787098069.571608:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787098069.571624:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098069.571655:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014440f expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098069.571662:0:6323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098069.571705:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b014440f expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098069.571720:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b014440f expref: 11 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098069.571735:0:6323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fa8531c7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1873908077694464:0@lo:104: 00000100:00100000:1.0:1787098069.571807:0:6323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098069.571869:0:6323:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bb68ad03 going to sleep for 11 seconds 00000100:00100000:3.0:1787098069.572080:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077694464 00000100:00100000:3.0:1787098069.572088:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077694464 00000100:00100000:3.0:1787098069.572144:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787098069.572153:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1d5233d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:6323:x1873908077694464:12345-0@lo:104: 00010000:00010000:3.0:1787098069.572166:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572234:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098069.572245:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1d5233d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:6323:x1873908077694464:12345-0@lo:104: Request processed in 94us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098069.572252:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787098069.572304:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098069.572308:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572316:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b3afc91f already unused, calling callback (00000000724d538e) 10000000:00010000:3.0:1787098069.572318:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572326:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098069.572332:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098069.572337:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787098069.572374:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572381:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098069.572397:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572403:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 00000000b3afc91f/0xb1d871f9b014440f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144416 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572418:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098069.572420:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098069.572421:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098069.572546:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000051148838 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077694592:0@lo:103: 00000100:00100000:3.0:1787098069.572578:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098069.572637:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077694592 00000100:00100000:3.0:1787098069.572642:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077694592 00010000:00010000:3.0:1787098069.572658:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014440f expref: 12 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098069.572678:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787098069.572684:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030fa0b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:3311:x1873908077694592:12345-0@lo:103: 00010000:00010000:3.0:1787098069.572693:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098069.572698:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014440f expref: 12 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572706:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b014440f expref: 12 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572721:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572728:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572738:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572744:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572750:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572764:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572770:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d0a707e already unused, calling callback (00000000e67fea98) 00010000:00010000:3.0:1787098069.572772:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572778:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572785:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098069.572793:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098069.572818:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030fa0b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:3311:x1873908077694592:12345-0@lo:103: Request processed in 135us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098069.572824:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787098069.572855:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000051148838 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077694592:0@lo:103: 00010000:00010000:0.0:1787098069.572996:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009942dde7/0xb1d871f9b0144416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b014440f expref: 11 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098069.573008:0:6323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fa8531c7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1873908077694464:0@lo:104: 00010000:00010000:0.0:1787098069.573019:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098069.573026:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098069.573040:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098069.573046:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000d0a707e/0xb1d871f9b0144455 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098070.421082:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098071.440423:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098071.695570:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787098071.695590:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eb0eeec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077694720:0@lo:400: 00000100:00100000:0.0:1787098071.695661:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098071.695766:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000093610a5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077694848:0@lo:400: 00000100:00100000:3.0:1787098071.695799:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098071.695896:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077694848 00000100:00100000:3.0:1787098071.695904:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077694848 00000100:00100000:3.0:1787098071.695949:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098071.695956:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051148838 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077694848:12345-0@lo:400: 00000100:00100000:3.0:1787098071.696008:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051148838 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077694848:12345-0@lo:400: Request processed in 52us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098071.696024:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787098071.696065:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000093610a5d x1873908077694848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098071.696078:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000093610a5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077694848:0@lo:400: 00000100:00100000:2.0:1787098071.696513:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077694720 00000100:00100000:2.0:1787098071.696518:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077694720 00000100:00100000:2.0:1787098071.696595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787098071.696601:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a08ff14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:3311:x1873908077694720:12345-0@lo:400: 00000100:00100000:2.0:1787098071.696646:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a08ff14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:3311:x1873908077694720:12345-0@lo:400: Request processed in 46us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098071.696652:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787098071.696715:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eb0eeec1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077694720:0@lo:400: 00010000:00010000:2.0:1787098072.464162:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098073.487650:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098074.511727:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098075.535442:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787098076.303383:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787098076.303393:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d72079cb000 from 1 10000000:01000000:3.0:1787098076.303399:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787098076.303456:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000632d587a/0xb1d871f9b014445c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098076.303470:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000632d587a/0xb1d871f9b014445c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098076.303481:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000632d587a/0xb1d871f9b014445c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098076.303506:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a89c07b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077694976:0@lo:101: 00000100:00100000:3.0:1787098076.303583:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098076.303737:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aba96109 going to sleep for 11 seconds 00000100:00100000:1.0:1787098076.303958:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077694976 00000100:00100000:1.0:1787098076.303967:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077694976 00000100:00100000:1.0:1787098076.304021:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787098076.304028:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080ea56d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:5841:x1873908077694976:12345-0@lo:101: 00010000:00010000:1.0:1787098076.304149:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098076.304163:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014445c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098076.304188:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014445c expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098076.304197:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd0a50f1/0xb1d871f9b0144463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014445c expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098076.304233:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd0a50f1, rc 0) 00000100:00100000:1.0:1787098076.304349:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080ea56d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077694976:12345-0@lo:101: Request processed in 321us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098076.304356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787098076.306726:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a89c07b3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077694976:0@lo:101: 00010000:00010000:0.0:1787098076.306761:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000632d587a/0xb1d871f9b014445c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098076.306773:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000632d587a/0xb1d871f9b014445c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098076.306864:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f10a69b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077695104:0@lo:501: 00000100:00100000:0.0:1787098076.306925:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098076.307218:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set 000000006a1fefde going to sleep for 11 seconds 00000100:00100000:2.0:1787098076.307552:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077695104 00000100:00100000:2.0:1787098076.307561:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077695104 00000100:00100000:2.0:1787098076.307621:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787098076.307630:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a00116d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077695104:12345-0@lo:501: 00000100:00100000:2.0:1787098076.307921:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a00116d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077695104:12345-0@lo:501: Request processed in 292us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098076.307929:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787098076.308042:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f10a69b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077695104:0@lo:501: 00000100:00100000:0.0:1787098076.310304:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f10a69b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077695232:0@lo:503: 00000100:00100000:0.0:1787098076.310395:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098076.310455:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set 000000006a1fefde going to sleep for 11 seconds 00000100:00100000:3.0:1787098076.310532:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077695232 00000100:00100000:3.0:1787098076.310541:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077695232 00000100:00100000:3.0:1787098076.310600:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787098076.310608:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be13f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077695232:12345-0@lo:503: 00000100:00100000:3.0:1787098076.310818:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be13f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077695232:12345-0@lo:503: Request processed in 210us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098076.310825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787098076.311236:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f10a69b4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077695232:0@lo:503: 00000100:00100000:0.0:1787098076.311839:0:6662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f10a69b4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6662:1873908077695360:0@lo:502: 00000100:00100000:0.0:1787098076.311894:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098076.311933:0:6662:0:(client.c:2702:ptlrpc_set_wait()) set 00000000af165435 going to sleep for 11 seconds 00000100:00100000:3.0:1787098076.311982:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077695360 00000100:00100000:3.0:1787098076.311988:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077695360 00000100:00100000:3.0:1787098076.312040:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787098076.312047:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ffdaff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6662:x1873908077695360:12345-0@lo:502: 00000100:00100000:3.0:1787098076.312415:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ffdaff1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6662:x1873908077695360:12345-0@lo:502: Request processed in 354us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098076.312423:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787098076.313078:0:6662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f10a69b4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6662:1873908077695360:0@lo:502: 00000020:01000000:0.0:1787098076.313113:0:6662:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787098076.313123:0:6662:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098076.313125:0:6662:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787098076.313131:0:6662:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d72079cb000 00000020:00000080:0.0:1787098076.313134:0:6662:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787098076.313184:0:6662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6662:1873908077695488:0@lo:502: 00000100:00100000:0.0:1787098076.313243:0:6662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098076.313309:0:6662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72076b8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787098076.313446:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077695488 00000100:00100000:1.0:1787098076.313452:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077695488 00000100:00100000:1.0:1787098076.313498:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787098076.313507:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6662:x1873908077695488:12345-0@lo:502: 00000100:00100000:1.0:1787098076.313673:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6662:x1873908077695488:12345-0@lo:502: Request processed in 166us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098076.313680:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787098076.313814:0:6662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6662:1873908077695488:0@lo:502: 00000020:01000000:0.0:1787098076.313834:0:6662:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098076.313839:0:6662:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098076.313841:0:6662:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787098076.313844:0:6662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787098076.314219:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787098076.314246:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787098076.314256:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098076.314269:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098076.559729:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098076.817573:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787098076.817598:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077695744:0@lo:400: 00000100:00100000:3.0:1787098076.817664:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077695616:0@lo:400: 00000100:00100000:0.0:1787098076.817672:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098076.817715:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098076.817776:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077695616 00000100:00100000:3.0:1787098076.817783:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077695616 00000100:00100000:3.0:1787098076.817833:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787098076.817842:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:3310:x1873908077695616:12345-0@lo:400: 00000100:00100000:3.0:1787098076.817901:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:3310:x1873908077695616:12345-0@lo:400: Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098076.817909:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787098076.817959:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077695616:0@lo:400: 00000100:00100000:2.0:1787098076.818027:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077695744 00000100:00100000:2.0:1787098076.818032:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077695744 00000100:00100000:2.0:1787098076.818065:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098076.818072:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077695744:12345-0@lo:400: 00000100:00100000:2.0:1787098076.818121:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077695744:12345-0@lo:400: Request processed in 49us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098076.818128:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787098076.818170:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d7227525180 x1873908077695744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098076.818183:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077695744:0@lo:400: 00010000:00010000:1.0:1787098077.584069:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098078.608398:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098079.636571:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787098079.679199:0:6699:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787098079.679204:0:6699:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787098079.679539:0:6699:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d7227639800 00000020:01000004:1.0:1787098079.679554:0:6699:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787098079.679566:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787098079.679587:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d723bac19c0) 00000020:00000080:1.0:1787098079.679602:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787098079.699710:0:6699:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787098079.699984:0:6699:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787098079.725354:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787098079.732014:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787098079.732050:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787098079.732124:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787098079.732151:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787098079.733197:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787098079.733209:0:6699:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787098079.733219:0:6699:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1d871f9b0144471 00000020:01000004:2.0:1787098079.733228:0:6699:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787098079.733250:0:6699:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787098079.733254:0:6699:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787098079.733260:0:6699:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787098079.734667:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787098079.734684:0:6699:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d7208e119c0) 00000020:00000080:2.0:1787098079.734702:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787098079.738943:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098079.739117:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787098079.739123:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787098079.750953:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787098079.750967:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787098079.753694:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787098079.753708:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787098079.756707:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787098079.756881:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787098079.756887:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787098079.757954:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787098079.757964:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787098079.801741:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098079.801956:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787098079.801962:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787098079.804399:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787098079.804415:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787098079.805106:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787098079.805114:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787098079.809666:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098079.809855:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787098079.809867:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787098079.811003:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787098079.811014:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787098079.852404:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787098079.852619:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787098079.852625:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787098079.856128:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787098079.856143:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787098079.857509:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787098079.857535:0:6699:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787098079.857547:0:6699:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787098079.879671:0:6699:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787098079.879712:0:6699:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787098079.879716:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787098079.879718:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787098079.879719:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098079.879721:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098079.879722:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098079.879724:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098079.879725:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098079.879727:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787098079.879728:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787098079.879731:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098079.879732:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787098079.879737:0:6699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787098079.879739:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787098079.879741:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787098079.879742:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098079.879743:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098079.879744:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098079.879746:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098079.879747:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098079.879748:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787098079.879749:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787098079.879751:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098079.879752:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787098079.879780:0:6699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787098079.879799:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077695872:0@lo:253: 00000100:00100000:0.0:1787098079.879874:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.880012:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206767840 going to sleep for 11 seconds 00000100:00100000:2.0:1787098079.880110:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077695872 00000100:00100000:2.0:1787098079.880117:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077695872 00000100:00100000:2.0:1787098079.880215:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787098079.880226:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077695872:12345-0@lo:253: 20000000:01000000:2.0:1787098079.880319:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787098079.880323:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787098079.880328:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787098079.880332:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787098079.881770:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787098079.881995:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787098079.882009:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787098079.882052:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787098079.882060:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787098079.882094:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787098079.882177:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787098079.882836:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787098079.882858:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:2.0:1787098079.882860:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:2.0:1787098079.882898:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787098079.882906:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787098079.882974:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787098079.882984:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:2.0:1787098079.883018:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787098079.883028:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787098079.883063:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787098079.883117:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787098079.885130:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787098079.885174:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:2.0:1787098079.885177:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:2.0:1787098079.885215:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787098079.885224:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787098079.885532:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787098079.885544:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:2.0:1787098079.885605:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787098079.885615:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787098079.885660:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787098079.885694:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787098079.885711:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787098079.885714:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787098079.885722:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787098079.885723:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787098079.885726:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787098079.885738:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787098079.885741:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787098079.885776:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787098079.885778:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787098079.886540:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787098079.886600:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787098079.886656:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787098079.886973:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787098079.887014:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787098079.887053:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787098079.887065:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787098079.887067:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787098079.889014:0:6714:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787098079.889098:0:6714:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787098079.889189:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787098079.889813:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787098079.889859:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787098079.889922:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787098079.889936:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787098079.889939:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787098079.890718:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787098079.890993:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787098079.891035:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787098079.891114:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1787098079.891132:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787098079.891168:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.891189:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7200030400/0xb1d871f9b0144398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144391 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.891197:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01443b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01443ad expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.891217:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b0144424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014441d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.891225:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.891616:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b0144424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b014441d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.891629:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b0144424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b014441d expref: 12 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098079.891644:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207463100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1873908077696000:0@lo:104: 00000100:00100000:2.0:1787098079.891711:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787098079.891801:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01443b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01443ad expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.891810:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01443b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01443ad expref: 12 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098079.891820:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1873908077696128:0@lo:104: 00000100:00100000:2.0:1787098079.891841:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787098079.891918:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7200030400/0xb1d871f9b0144398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144391 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.891926:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7200030400/0xb1d871f9b0144398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144391 expref: 12 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098079.891934:0:5838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1873908077696256:0@lo:104: 00000100:00100000:2.0:1787098079.891964:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098079.892033:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077696000 00000100:00100000:1.0:1787098079.892040:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077696000 00000100:00100000:1.0:1787098079.892095:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077696128 00000100:00100000:1.0:1787098079.892099:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077696128 00000100:00100000:1.0:1787098079.892114:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787098079.892122:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:5838:x1873908077696000:12345-0@lo:104: 00010000:00010000:1.0:1787098079.892135:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b014441d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.892202:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787098079.892209:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:5838:x1873908077696000:12345-0@lo:104: Request processed in 88us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098079.892217:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787098079.892234:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787098079.892240:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5838:x1873908077696128:12345-0@lo:104: 00010000:00010000:1.0:1787098079.892248:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b01443ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.892320:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787098079.892325:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5838:x1873908077696128:12345-0@lo:104: Request processed in 86us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098079.892332:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787098079.892349:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787098079.892355:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b014441d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.892363:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030600 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098079.892367:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b014441d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.892376:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b014441d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.892540:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1787098079.892654:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b014441d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098079.892662:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787098079.892699:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b014441d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.892705:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098079.892722:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b014441d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.892730:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b014441d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144424 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.892741:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098079.892743:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098079.892744:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098079.892756:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077696384:0@lo:103: 00000100:00100000:1.0:1787098079.892786:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098079.892912:0:5838:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710491a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787098079.892931:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207463100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1873908077696000:0@lo:104: 00000100:00100000:2.0:1787098079.892938:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1873908077696128:0@lo:104: 00000100:00100000:1.0:1787098079.892989:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077696256 00000100:00100000:1.0:1787098079.892993:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077696256 00000100:00100000:1.0:1787098079.893013:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787098079.893019:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5838:x1873908077696256:12345-0@lo:104: 00010000:00010000:1.0:1787098079.893026:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d720f090800/0xb1d871f9b0144391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.893102:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787098079.893108:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5838:x1873908077696256:12345-0@lo:104: Request processed in 89us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098079.893122:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098079.893192:0:5838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5838:1873908077696256:0@lo:104: 00010000:00010000:2.0:1787098079.893215:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.893729:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098079.893735:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d720f090800/0xb1d871f9b0144391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.893742:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f090800 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098079.893746:0:6716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090800/0xb1d871f9b0144391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.893755:0:6716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d720f090800/0xb1d871f9b0144391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098079.893761:0:6716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090800/0xb1d871f9b0144391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098079.893767:0:6716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787098079.893793:0:6716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d720f090800/0xb1d871f9b0144391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.893800:0:6716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098079.893817:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d720f090800/0xb1d871f9b0144391 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.893824:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d720f090800/0xb1d871f9b0144391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144398 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098079.893844:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077696512:0@lo:103: 00000100:00100000:1.0:1787098079.893880:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787098079.893918:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098079.893927:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098079.893965:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b01443ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.893973:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f090400 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098079.893977:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b01443ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.893985:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b01443ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098079.893992:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b01443ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098079.893997:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787098079.894013:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b01443ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.894019:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098079.894033:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b01443ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.894040:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b01443ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01443b4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.894061:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098079.894062:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098079.894113:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077696384 00000100:00100000:3.0:1787098079.894119:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077696384 00010000:00010000:3.0:1787098079.894142:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b0144424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014441d expref: 13 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098079.894175:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077696512 00000100:00100000:3.0:1787098079.894179:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077696512 00010000:00010000:3.0:1787098079.894191:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7200030400/0xb1d871f9b0144398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144391 expref: 14 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098079.894204:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787098079.894211:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3312:x1873908077696384:12345-0@lo:103: 00010000:00010000:3.0:1787098079.894222:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098079.894228:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b0144424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014441d expref: 14 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894238:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b0144424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b014441d expref: 14 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894251:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b0144424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b014441d expref: 14 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894298:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098079.894339:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:3312:x1873908077696384:12345-0@lo:103: Request processed in 127us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.894355:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787098079.894376:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787098079.894382:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:3309:x1873908077696512:12345-0@lo:103: 00010000:00010000:3.0:1787098079.894404:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098079.894409:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7200030400/0xb1d871f9b0144398 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144391 expref: 12 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894418:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7200030400/0xb1d871f9b0144398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144391 expref: 12 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894429:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200030400/0xb1d871f9b0144398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144391 expref: 12 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894441:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098079.894466:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:3309:x1873908077696512:12345-0@lo:103: Request processed in 84us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.894472:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787098079.894493:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077696640:0@lo:103: 00000100:00100000:3.0:1787098079.894518:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098079.894549:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077696640 00000100:00100000:3.0:1787098079.894553:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077696640 00010000:00010000:3.0:1787098079.894565:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01443b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01443ad expref: 11 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098079.894580:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787098079.894586:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:3310:x1873908077696640:12345-0@lo:103: 00010000:00010000:3.0:1787098079.894594:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098079.894599:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01443b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01443ad expref: 11 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894614:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01443b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01443ad expref: 11 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894625:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01443b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01443ad expref: 11 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894636:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894644:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894656:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894663:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894670:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894677:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894682:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204fa00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098079.894686:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894693:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894717:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894726:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098079.894753:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:3310:x1873908077696640:12345-0@lo:103: Request processed in 168us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.894760:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787098079.894798:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077696384:0@lo:103: 00000100:00100000:3.0:1787098079.894824:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077696640:0@lo:103: 00010000:00010000:3.0:1787098079.894840:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894848:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.894855:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204fa00/0xb1d871f9b014447f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787098079.894870:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1787098079.895520:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098079.895772:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098079.895798:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077696512:0@lo:103: 00010000:00010000:2.0:1787098079.896725:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098079.941573:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:6699:x1873908077695872:12345-0@lo:253: Request processed in 61339us (61688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.941590:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787098079.941705:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077695872:0@lo:253: 10000000:01000000:0.0:1787098079.941740:0:6699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787098079.941743:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787098079.941745:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787098079.941747:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098079.941748:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787098079.941750:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098079.941751:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098079.941753:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098079.941755:0:6699:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787098079.941756:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098079.941757:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787098079.941777:0:6699:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d7227639800 from lustre-OST0000 10000000:01000000:0.0:1787098079.941803:0:6699:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787098079.941806:0:6699:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787098079.941813:0:6699:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d7208e14d40 local copy 10000000:01000000:0.0:1787098079.941818:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787098079.941852:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.941864:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.941874:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098079.941895:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077696768:0@lo:101: 00000100:00100000:0.0:1787098079.941935:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.942028:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206de4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787098079.942089:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077696768 00000100:00100000:2.0:1787098079.942095:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077696768 00000100:00100000:2.0:1787098079.942131:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787098079.942140:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:6699:x1873908077696768:12345-0@lo:101: 00010000:00010000:2.0:1787098079.942164:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098079.942178:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204e800/0xb1d871f9b014448d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144486 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.942203:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204e800/0xb1d871f9b014448d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144486 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.942214:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204e800/0xb1d871f9b014448d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144486 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.942224:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204e800, rc 0) 00000100:00100000:2.0:1787098079.942275:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:6699:x1873908077696768:12345-0@lo:101: Request processed in 136us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098079.942305:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787098079.942443:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077696768:0@lo:101: 00010000:00010000:0.0:1787098079.942456:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.942477:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098079.942564:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077696896:0@lo:501: 00000100:00100000:0.0:1787098079.942593:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098079.942659:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077696896 00000100:00100000:2.0:1787098079.942664:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077696896 00000100:00100000:2.0:1787098079.942690:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787098079.942696:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:6699:x1873908077696896:12345-0@lo:501: 00000100:00100000:2.0:1787098079.942878:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:6699:x1873908077696896:12345-0@lo:501: Request processed in 181us (283us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787098079.942894:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787098079.943064:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206de4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787098079.943081:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077696896:0@lo:501: 10000000:01000000:0.0:1787098079.943093:0:6699:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787098079.943121:0:6699:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787098079.943126:0:6699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.943134:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.943142:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.943216:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787098079.943235:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d7227639800 10000000:01000000:0.0:1787098079.943240:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787098079.943245:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d7208e14d40 10000000:01000000:0.0:1787098079.943248:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787098079.943252:0:6699:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8d7208e14d40 from 1 10000000:01000000:0.0:1787098079.943254:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787098079.943418:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.943436:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.943445:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098079.943459:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697024:0@lo:101: 00000100:00100000:0.0:1787098079.943490:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.943563:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72090e3e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787098079.943618:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098079.943625:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.943632:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098079.943635:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.943643:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098079.943651:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098079.943657:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787098079.943678:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.943685:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098079.943716:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.943724:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1d871f9b014448d expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.943739:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098079.943742:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098079.943743:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098079.943796:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787098079.943808:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077697152:0@lo:103: 00000100:00100000:0.0:1787098079.943835:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098079.943907:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077697152 00000100:00100000:1.0:1787098079.943912:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077697152 00000100:00100000:1.0:1787098079.943956:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787098079.943965:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:3312:x1873908077697152:12345-0@lo:103: 00010000:00010000:1.0:1787098079.943988:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098079.944002:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204e800/0xb1d871f9b014448d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b0144486 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.944015:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098079.944045:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:3312:x1873908077697152:12345-0@lo:103: Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098079.944053:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787098079.944122:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077697152:0@lo:103: 00000100:00100000:2.0:1787098079.944217:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077697024 00000100:00100000:2.0:1787098079.944221:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077697024 00000100:00100000:2.0:1787098079.944476:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787098079.944485:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+9:6699:x1873908077697024:12345-0@lo:101: 00010000:00010000:2.0:1787098079.944495:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098079.944507:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204f400/0xb1d871f9b014449b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144494 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.944523:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204f400/0xb1d871f9b014449b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144494 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.944534:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204f400/0xb1d871f9b014449b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144494 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.944541:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204f400, rc 0) 00000100:00100000:2.0:1787098079.944584:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:6699:x1873908077697024:12345-0@lo:101: Request processed in 101us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098079.944591:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787098079.944656:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697024:0@lo:101: 00010000:00010000:0.0:1787098079.944669:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014449b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.944677:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b014449b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098079.944692:0:6699:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787098079.944709:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014449b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.944717:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014449b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098079.944740:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787098079.944744:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787098079.944750:0:6699:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787098079.944752:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787098079.944768:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.944776:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.944783:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098079.944797:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697280:0@lo:101: 00000100:00100000:0.0:1787098079.944827:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.944959:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72090e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098079.945021:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077697280 00000100:00100000:3.0:1787098079.945026:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077697280 00000100:00100000:3.0:1787098079.945049:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787098079.945055:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+10:6699:x1873908077697280:12345-0@lo:101: 00010000:00010000:3.0:1787098079.945062:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098079.945076:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01444a2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.945090:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01444a2 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.945097:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01444a2 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.945104:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6e00, rc 0) 00000100:00100000:3.0:1787098079.945144:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697280:12345-0@lo:101: Request processed in 89us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.945150:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787098079.945252:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697280:0@lo:101: 00010000:00010000:0.0:1787098079.945274:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.945303:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098079.945397:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697408:0@lo:501: 00000100:00100000:0.0:1787098079.945436:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.945460:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72090e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098079.945580:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077697408 00000100:00100000:3.0:1787098079.945585:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077697408 00000100:00100000:3.0:1787098079.945604:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787098079.945610:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697408:12345-0@lo:501: 00000100:00100000:3.0:1787098079.945818:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697408:12345-0@lo:501: Request processed in 207us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.945825:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787098079.945899:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697408:0@lo:501: 00000100:00100000:0.0:1787098079.945944:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697536:0@lo:503: 00000100:00100000:0.0:1787098079.945983:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.946012:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72090e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098079.946063:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077697536 00000100:00100000:3.0:1787098079.946067:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077697536 00000100:00100000:3.0:1787098079.946085:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787098079.946091:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697536:12345-0@lo:503: 00000100:00100000:3.0:1787098079.946249:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697536:12345-0@lo:503: Request processed in 157us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.946255:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787098079.946422:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697536:0@lo:503: 00000040:00080000:0.0:1787098079.946679:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787098079.946731:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697664:0@lo:502: 00000100:00100000:0.0:1787098079.946767:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.946801:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209a770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098079.946868:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077697664 00000100:00100000:2.0:1787098079.946873:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077697664 00000100:00100000:2.0:1787098079.946897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787098079.946905:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697664:12345-0@lo:502: 00000100:00100000:2.0:1787098079.947043:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697664:12345-0@lo:502: Request processed in 139us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098079.947051:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787098079.947138:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697664:0@lo:502: 00000040:00080000:0.0:1787098079.947501:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787098079.947554:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787098079.947593:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787098079.947644:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787098079.947682:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787098079.947720:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787098079.947745:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697792:0@lo:502: 00000100:00100000:0.0:1787098079.947786:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.947819:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209a770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098079.947890:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077697792 00000100:00100000:3.0:1787098079.947894:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077697792 00000100:00100000:3.0:1787098079.947923:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787098079.947931:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697792:12345-0@lo:502: 00000100:00100000:3.0:1787098079.948087:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697792:12345-0@lo:502: Request processed in 157us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.948094:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787098079.948240:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697792:0@lo:502: 00000040:00080000:0.0:1787098079.948467:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787098079.948478:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787098079.949000:0:6718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787098079.949009:0:6718:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787098079.949015:0:6718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098079.949018:0:6718:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787098079.949023:0:6718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787098079.949037:0:6718:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d72065eb380) 00000020:00000080:3.0:1787098079.949059:0:6718:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787098079.949064:0:6718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787098079.949129:0:6718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7227639800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787098079.949137:0:6718:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787098079.949143:0:6718:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1d871f9b01444b7 00010000:00010000:2.0:1787098079.953950:0:6718:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787098079.954461:0:6718:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787098079.957040:0:6718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787098079.957759:0:6718:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787098079.963666:0:6718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787098079.964106:0:6718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787098079.966235:0:6718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787098079.966247:0:6718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098079.966254:0:6718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098079.966398:0:6718:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787098079.966407:0:6718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098079.966413:0:6718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098079.966414:0:6718:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787098079.966417:0:6718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787098079.966419:0:6718:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787098079.966479:0:6718:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098079.966482:0:6718:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098079.966484:0:6718:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787098079.966488:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787098079.966986:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787098079.967012:0:6699:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787098079.967039:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.967352:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098079.967369:0:6699:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7227639800 from 1 10000000:01000000:0.0:1787098079.967372:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787098079.967753:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.967763:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.967774:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098079.967875:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697920:0@lo:101: 00000100:00100000:0.0:1787098079.967949:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.968036:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209a770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098079.968112:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077697920 00000100:00100000:2.0:1787098079.968120:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077697920 00000100:00100000:2.0:1787098079.968178:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787098079.968187:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:6699:x1873908077697920:12345-0@lo:101: 00010000:00010000:2.0:1787098079.968202:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098079.968215:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01444be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.968240:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01444be expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.968252:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01444be expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.968262:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204f600, rc 0) 00000100:00100000:2.0:1787098079.968355:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077697920:12345-0@lo:101: Request processed in 168us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098079.968364:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787098079.968644:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077697920:0@lo:101: 00010000:00010000:0.0:1787098079.968662:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.968673:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098079.968778:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698048:0@lo:501: 00000100:00100000:0.0:1787098079.969031:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.969102:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209a770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098079.969192:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077698048 00000100:00100000:1.0:1787098079.969197:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077698048 00000100:00100000:1.0:1787098079.969262:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787098079.969271:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077698048:12345-0@lo:501: 00000100:00100000:1.0:1787098079.969559:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077698048:12345-0@lo:501: Request processed in 288us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098079.969567:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787098079.969601:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698048:0@lo:501: 00000100:00100000:0.0:1787098079.969634:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698176:0@lo:503: 00000100:00100000:0.0:1787098079.969679:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.969701:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209a770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098079.969706:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077698176 00000100:00100000:1.0:1787098079.969710:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077698176 00000100:00100000:1.0:1787098079.969736:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787098079.969742:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077698176:12345-0@lo:503: 00000100:00100000:1.0:1787098079.970197:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077698176:12345-0@lo:503: Request processed in 454us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098079.970204:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787098079.970349:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698176:0@lo:503: 00000040:00080000:2.0:1787098079.970975:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787098079.971044:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698304:0@lo:502: 00000100:00100000:2.0:1787098079.971098:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098079.971136:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710491ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787098079.971171:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077698304 00000100:00100000:2.0:1787098079.971177:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077698304 00000100:00100000:2.0:1787098079.971263:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787098079.971272:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077698304:12345-0@lo:502: 00000100:00100000:2.0:1787098079.971565:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077698304:12345-0@lo:502: Request processed in 294us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098079.971573:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787098079.971701:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698304:0@lo:502: 00000040:00080000:2.0:1787098079.972022:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787098079.972072:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787098079.972096:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698432:0@lo:502: 00000100:00100000:2.0:1787098079.972131:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098079.972172:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710491ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787098079.972232:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077698432 00000100:00100000:1.0:1787098079.972237:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077698432 00000100:00100000:1.0:1787098079.972337:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787098079.972345:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077698432:12345-0@lo:502: 00000100:00100000:1.0:1787098079.972626:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077698432:12345-0@lo:502: Request processed in 281us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098079.972634:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787098079.972704:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698432:0@lo:502: 00000040:00080000:2.0:1787098079.972876:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787098079.972887:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787098079.973462:0:6722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098079.973473:0:6722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098079.973476:0:6722:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787098079.973483:0:6722:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7227639800 00000020:00000080:1.0:1787098079.973485:0:6722:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787098079.973507:0:6722:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098079.973510:0:6722:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098079.973511:0:6722:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787098079.973514:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787098079.973653:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787098079.973673:0:6699:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787098079.973723:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.973739:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098079.973777:0:6699:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787098079.973781:0:6699:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d7227639800 10000000:01000000:2.0:1787098079.973784:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d7227639800 10000000:01000000:2.0:1787098079.973788:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787098079.973793:0:6699:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d7227639800 from 1 10000000:01000000:2.0:1787098079.973795:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787098079.973904:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.973913:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098079.973923:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098079.973944:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698560:0@lo:101: 00000100:00100000:2.0:1787098079.973990:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098079.974031:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710491ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098079.974113:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077698560 00000100:00100000:3.0:1787098079.974119:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077698560 00000100:00100000:3.0:1787098079.974170:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787098079.974177:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077698560:12345-0@lo:101: 00010000:00010000:3.0:1787098079.974188:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098079.974200:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01444cc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.974221:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01444cc expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.974232:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01444cc expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098079.974241:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7000, rc 0) 00000100:00100000:3.0:1787098079.974364:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077698560:12345-0@lo:101: Request processed in 187us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.974371:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787098079.974529:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698560:0@lo:101: 00010000:00010000:1.0:1787098079.974542:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098079.974550:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098079.974629:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698688:0@lo:501: 00000100:00100000:1.0:1787098079.974655:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098079.974707:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7f8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787098079.974751:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077698688 00000100:00100000:2.0:1787098079.974755:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077698688 00000100:00100000:2.0:1787098079.974814:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787098079.974822:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077698688:12345-0@lo:501: 00000100:00100000:2.0:1787098079.975054:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077698688:12345-0@lo:501: Request processed in 233us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098079.975061:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787098079.975201:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698688:0@lo:501: 00000100:00100000:0.0:1787098079.975229:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698816:0@lo:503: 00000100:00100000:0.0:1787098079.975364:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.975430:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209a77600 going to sleep for 11 seconds 00000100:00100000:2.0:1787098079.975460:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077698816 00000100:00100000:2.0:1787098079.975464:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077698816 00000100:00100000:2.0:1787098079.975493:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787098079.975500:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077698816:12345-0@lo:503: 00000100:00100000:2.0:1787098079.975667:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077698816:12345-0@lo:503: Request processed in 167us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098079.975675:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787098079.975723:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698816:0@lo:503: 00000040:00080000:0.0:1787098079.975960:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787098079.976013:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698944:0@lo:502: 00000100:00100000:0.0:1787098079.976046:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.976102:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209a77600 going to sleep for 11 seconds 00000100:00100000:2.0:1787098079.976136:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077698944 00000100:00100000:2.0:1787098079.976141:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077698944 00000100:00100000:2.0:1787098079.976219:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787098079.976228:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077698944:12345-0@lo:502: 00000100:00100000:2.0:1787098079.976414:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077698944:12345-0@lo:502: Request processed in 187us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098079.976422:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787098079.976493:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077698944:0@lo:502: 00000040:00080000:0.0:1787098079.976730:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787098079.976776:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787098079.976809:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787098079.976855:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787098079.976893:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787098079.976935:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787098079.976965:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787098079.976992:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787098079.977027:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787098079.977056:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787098079.977090:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787098079.977148:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787098079.977204:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787098079.977241:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787098079.977310:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787098079.977349:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787098079.977394:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787098079.977451:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787098079.977488:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787098079.977519:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787098079.977566:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787098079.977601:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787098079.977630:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787098079.977689:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787098079.977726:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787098079.977775:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787098079.977827:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787098079.977884:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787098079.977923:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077699072:0@lo:502: 00000100:00100000:0.0:1787098079.977981:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.978527:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209a77600 going to sleep for 11 seconds 00000100:00100000:3.0:1787098079.978608:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077699072 00000100:00100000:3.0:1787098079.978614:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077699072 00000100:00100000:3.0:1787098079.978653:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787098079.978663:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077699072:12345-0@lo:502: 00000100:00100000:3.0:1787098079.978874:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077699072:12345-0@lo:502: Request processed in 212us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.978882:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787098079.978976:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077699072:0@lo:502: 00000040:00080000:0.0:1787098079.979048:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787098079.979060:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787098079.979719:0:6723:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787098079.979733:0:6723:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d72065ecd40) 00000020:00000080:3.0:1787098079.979754:0:6723:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787098079.980006:0:6723:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7227639800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787098079.980011:0:6723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7227639800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787098079.980013:0:6723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7227639800 3 00010000:00080000:3.0:1787098079.980043:0:6723:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7104c20000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1787098079.981640:0:6723:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787098079.981757:0:6723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787098079.981797:0:6723:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787098079.981823:0:6723:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb1d871f9b01444e1 00000100:00080000:3.0:1787098079.981836:0:6723:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787098079.981841:0:6723:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d7104c20000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1787098079.981880:0:6723:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723b2e2d80 x1873908077699200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787098079.981907:0:6723:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787098079.981992:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077699328:0@lo:400: 00000100:00100000:3.0:1787098079.982055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098079.982120:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077699328 00000100:00100000:3.0:1787098079.982126:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077699328 00000100:00100000:3.0:1787098079.982192:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787098079.982202:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077699328:12345-0@lo:400: 00000100:00100000:3.0:1787098079.982255:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077699328:12345-0@lo:400: Request processed in 55us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.982262:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787098079.982321:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d723b2e1f80 x1873908077699328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098079.982335:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077699328:0@lo:400: 00000100:00100000:2.0:1787098079.982659:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1873908077699200:0@lo:38: 00000100:00100000:2.0:1787098079.982697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098079.984483:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077699200 00000100:00100000:3.0:1787098079.984496:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077699200 00000100:00100000:3.0:1787098079.984575:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787098079.984583:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1873908077699200:12345-0@lo:38: 00010000:00080000:3.0:1787098079.984610:0:5844:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1787098079.984643:0:5844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb1d871f9b01444e8 00000004:00100000:3.0:1787098079.984657:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787098079.984690:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8d7104d95000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787098079.984816:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873908077699200:12345-0@lo:38: Request processed in 232us (2118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098079.984823:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787098079.985482:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d723b2e2d80 x1873908077699200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787098089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098079.985495:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787098079.985503:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787098079.985512:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787098079.985524:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787098079.985527:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7104c20000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787098079.985533:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1873908077699200:0@lo:38: 00000040:00080000:3.0:1787098079.986702:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787098079.988869:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787098079.988900:0:6699:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787098079.988926:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098079.988945:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787098079.988990:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787098079.988992:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787098079.988993:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098079.988995:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098079.988996:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098079.989001:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098079.989002:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098079.989004:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787098079.989004:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787098079.989006:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098079.989007:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787098079.989011:0:6699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787098079.989013:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787098079.989014:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787098079.989015:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098079.989016:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098079.989017:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098079.989018:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098079.989018:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098079.989019:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787098079.989020:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787098079.989021:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098079.989022:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787098079.989060:0:6699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787098079.989080:0:6699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077699456:0@lo:253: 00000100:00100000:0.0:1787098079.989166:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098079.989213:0:6699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209a770c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098079.989382:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077699456 00000100:00100000:3.0:1787098079.989390:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077699456 00000100:00100000:3.0:1787098079.989444:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787098079.989454:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6699:x1873908077699456:12345-0@lo:253: 20000000:01000000:3.0:1787098079.989482:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787098079.989502:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787098080.010365:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787098080.010387:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787098080.010491:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787098080.010496:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787098080.010517:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.010534:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144440 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.010543:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.010582:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144440 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.010595:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144440 expref: 13 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098080.010608:0:5859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1873908077699584:0@lo:104: 00000100:00100000:1.0:1787098080.010672:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098080.010731:0:5859:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7f8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098080.011075:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077699584 00000100:00100000:3.0:1787098080.011083:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077699584 00000100:00100000:3.0:1787098080.011130:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787098080.011138:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5859:x1873908077699584:12345-0@lo:104: 00010000:00010000:3.0:1787098080.011163:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b0144440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098080.011224:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098080.011230:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5859:x1873908077699584:12345-0@lo:104: Request processed in 93us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098080.011237:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787098080.011417:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098080.011423:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b0144440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011432:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204f000 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098080.011436:0:6716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b0144440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011462:0:6716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b0144440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098080.011469:0:6716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b0144440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098080.011475:0:6716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787098080.011505:0:6716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b0144440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011511:0:6716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098080.011528:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b0144440 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011534:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b0144440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144447 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011550:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098080.011551:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098080.011553:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098080.011574:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077699712:0@lo:103: 00000100:00100000:1.0:1787098080.011606:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098080.011649:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077699712 00000100:00100000:1.0:1787098080.011654:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077699712 00010000:00010000:1.0:1787098080.011671:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144440 expref: 14 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098080.011692:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787098080.011699:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d721fa9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3309:x1873908077699712:12345-0@lo:103: 00010000:00010000:1.0:1787098080.011718:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098080.011723:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144440 expref: 14 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011733:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144440 expref: 14 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011750:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011757:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787098080.011768:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001294412s 00010000:00010000:1.0:1787098080.011772:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011779:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011786:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011791:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011796:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f090800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098080.011801:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011808:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011823:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011833:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098080.011862:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d721fa9a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3309:x1873908077699712:12345-0@lo:103: Request processed in 163us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098080.011869:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787098080.011926:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077699712:0@lo:103: 00010000:00010000:1.0:1787098080.011956:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144440 expref: 13 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098080.011966:0:5859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1873908077699584:0@lo:104: 00010000:00010000:1.0:1787098080.011978:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011985:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011990:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098080.011996:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f090800/0xb1d871f9b01444ef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098080.018555:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:6699:x1873908077699456:12345-0@lo:253: Request processed in 29091us (29378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098080.018571:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787098080.018682:0:6699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:6699:1873908077699456:0@lo:253: 10000000:01000000:3.0:1787098080.018700:0:6699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787098080.018704:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787098080.018706:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787098080.018707:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787098080.018709:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787098080.018710:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787098080.018711:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787098080.018712:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787098080.018714:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787098080.018716:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787098080.018718:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787098080.018719:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787098080.018737:0:6699:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787098080.023988:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787098080.024203:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787098080.024572:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787098080.024759:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787098080.024959:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787098080.025220:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787098080.026377:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787098080.171702:0:6699:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787098080.171710:0:6699:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787098080.171751:0:6699:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787098080.171822:0:6699:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787098080.171838:0:6699:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787098080.171869:0:6699:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787098080.660962:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098081.679754:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787098082.001017:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787098082.001025:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d72079cb000 from 21 10000000:01000000:2.0:1787098082.001031:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787098082.001087:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.001100:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.001123:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098082.001151:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077699840:0@lo:101: 00000100:00100000:2.0:1787098082.001219:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098082.001303:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206817b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787098082.001480:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077699840 00000100:00100000:1.0:1787098082.001490:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077699840 00000100:00100000:1.0:1787098082.001542:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787098082.001552:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077699840:12345-0@lo:101: 00010000:00010000:1.0:1787098082.001574:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098082.001588:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01444f6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.001613:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01444f6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.001623:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01444f6 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.001633:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d720f090200, rc 0) 00000100:00100000:1.0:1787098082.001765:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077699840:12345-0@lo:101: Request processed in 214us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098082.001773:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787098082.002526:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077699840:0@lo:101: 00010000:00010000:3.0:1787098082.002548:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098082.002571:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098082.005077:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077699968:0@lo:501: 00000100:00100000:2.0:1787098082.005167:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098082.005203:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206817b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.005226:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077699968 00000100:00100000:2.0:1787098082.005233:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077699968 00000100:00100000:2.0:1787098082.005272:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787098082.005296:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077699968:12345-0@lo:501: 00000100:00100000:2.0:1787098082.005572:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077699968:12345-0@lo:501: Request processed in 291us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098082.005579:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787098082.005624:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077699968:0@lo:501: 00000100:00100000:2.0:1787098082.005656:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700096:0@lo:503: 00000100:00100000:2.0:1787098082.005699:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098082.005728:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203f39600 going to sleep for 11 seconds 00000100:00100000:1.0:1787098082.006051:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077700096 00000100:00100000:1.0:1787098082.006057:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077700096 00000100:00100000:1.0:1787098082.006088:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787098082.006097:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077700096:12345-0@lo:503: 00000100:00100000:1.0:1787098082.007146:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077700096:12345-0@lo:503: Request processed in 927us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098082.007149:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207463480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700096:0@lo:503: 00000100:00100000:1.0:1787098082.007299:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787098082.007654:0:6844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6844:1873908077700224:0@lo:502: 00000100:00100000:3.0:1787098082.007714:0:6844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098082.007757:0:6844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.007898:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077700224 00000100:00100000:2.0:1787098082.007904:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077700224 00000100:00100000:2.0:1787098082.007953:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787098082.007962:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6844:x1873908077700224:12345-0@lo:502: 00000100:00100000:2.0:1787098082.008199:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6844:x1873908077700224:12345-0@lo:502: Request processed in 238us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098082.008207:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787098082.008386:0:6844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6844:1873908077700224:0@lo:502: 00000100:00100000:1.0:1787098082.008566:0:6844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6844:1873908077700352:0@lo:502: 00000100:00100000:1.0:1787098082.008607:0:6844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098082.008629:0:6844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72064173c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.008676:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077700352 00000100:00100000:2.0:1787098082.008680:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077700352 00000100:00100000:2.0:1787098082.008750:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787098082.008757:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6844:x1873908077700352:12345-0@lo:502: 00000100:00100000:2.0:1787098082.008905:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:6844:x1873908077700352:12345-0@lo:502: Request processed in 148us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098082.008912:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787098082.008972:0:6844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6844:1873908077700352:0@lo:502: 00000040:00080000:1.0:1787098082.008994:0:6844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787098082.010823:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787098082.010867:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787098082.010881:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.010895:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098082.010905:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787098082.010908:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d72079cb000 from 4 10000000:01000000:1.0:1787098082.010911:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787098082.010952:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.010960:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.010970:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098082.010993:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700480:0@lo:101: 00000100:00100000:1.0:1787098082.011058:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098082.013238:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72064173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098082.018613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077700480 00000100:00100000:3.0:1787098082.018629:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077700480 00000100:00100000:3.0:1787098082.018687:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787098082.018696:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077700480:12345-0@lo:101: 00010000:00010000:3.0:1787098082.018713:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098082.018732:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144504 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098082.018757:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144504 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098082.018770:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144504 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098082.018779:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6000, rc 0) 00000100:00100000:3.0:1787098082.018860:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077700480:12345-0@lo:101: Request processed in 164us (7801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098082.018866:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787098082.018913:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700480:0@lo:101: 00010000:00010000:1.0:1787098082.018932:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.018942:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098082.019013:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700608:0@lo:256: 00000100:00100000:1.0:1787098082.019070:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098082.019121:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72064173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098082.019574:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077700608 00000100:00100000:3.0:1787098082.019580:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077700608 00000100:00100000:3.0:1787098082.019629:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787098082.019637:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077700608:12345-0@lo:256: 20000000:01000000:3.0:1787098082.019652:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787098082.019667:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787098082.019670:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787098082.019751:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077700608:12345-0@lo:256: Request processed in 115us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098082.019759:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787098082.019810:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700608:0@lo:256: 10000000:01000000:1.0:1787098082.019852:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787098082.019861:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.019870:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098082.019879:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787098082.019881:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787098082.019884:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787098082.019904:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.019912:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.019920:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098082.019933:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700736:0@lo:101: 00000100:00100000:1.0:1787098082.019962:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098082.019993:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72064173c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.020552:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077700736 00000100:00100000:2.0:1787098082.020560:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077700736 00000100:00100000:2.0:1787098082.020606:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787098082.020614:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077700736:12345-0@lo:101: 00010000:00010000:2.0:1787098082.020624:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098082.020636:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144512 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.020656:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144512 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.020666:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144512 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.020675:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204fa00, rc 0) 00000100:00100000:2.0:1787098082.020714:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077700736:12345-0@lo:101: Request processed in 100us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098082.020732:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787098082.020765:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700736:0@lo:101: 00010000:00010000:1.0:1787098082.020787:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098082.020797:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098082.020848:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700864:0@lo:501: 00000100:00100000:1.0:1787098082.020877:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098082.020909:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72064173c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.021015:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077700864 00000100:00100000:2.0:1787098082.021019:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077700864 00000100:00100000:2.0:1787098082.021047:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787098082.021053:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077700864:12345-0@lo:501: 00000100:00100000:2.0:1787098082.021316:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077700864:12345-0@lo:501: Request processed in 262us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098082.021324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787098082.021353:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700864:0@lo:501: 00000100:00100000:1.0:1787098082.021396:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700992:0@lo:503: 00000100:00100000:1.0:1787098082.021435:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098082.021462:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72064173c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.021492:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077700992 00000100:00100000:2.0:1787098082.021498:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077700992 00000100:00100000:2.0:1787098082.021528:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787098082.021534:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077700992:12345-0@lo:503: 00000100:00100000:2.0:1787098082.021735:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077700992:12345-0@lo:503: Request processed in 201us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098082.021742:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787098082.021821:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077700992:0@lo:503: 00000100:00100000:3.0:1787098082.022200:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6846:1873908077701120:0@lo:502: 00000100:00100000:3.0:1787098082.022242:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098082.022269:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.022345:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077701120 00000100:00100000:2.0:1787098082.022350:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077701120 00000100:00100000:2.0:1787098082.022382:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787098082.022389:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:6846:x1873908077701120:12345-0@lo:502: 00000100:00100000:2.0:1787098082.022749:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:6846:x1873908077701120:12345-0@lo:502: Request processed in 359us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098082.022757:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787098082.024133:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6846:1873908077701120:0@lo:502: 00000020:01000000:2.0:1787098082.024239:0:6846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787098082.024247:0:6846:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787098082.024256:0:6846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098082.024258:0:6846:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787098082.024263:0:6846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787098082.024273:0:6846:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:2.0:1787098082.024310:0:6846:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787098082.024313:0:6846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787098082.024337:0:6846:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d720655b380) 00000020:00000080:2.0:1787098082.024357:0:6846:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787098082.024364:0:6846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787098082.024691:0:6846:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787098082.024696:0:6846:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787098082.024704:0:6846:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b0144527 00010000:00080000:2.0:1787098082.024736:0:6846:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d724028d000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1787098082.024947:0:6846:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787098082.080333:0:6846:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787098082.080358:0:6846:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787098082.080952:0:6846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787098082.082212:0:6846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787098082.082698:0:6846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787098082.082859:0:6846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787098082.084499:0:6851:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787098082.084505:0:6851:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787098082.085947:0:6846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787098082.085960:0:6846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787098082.085994:0:6846:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787098082.086013:0:6846:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b014452e 00000100:00080000:0.0:1787098082.086024:0:6846:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787098082.086030:0:6846:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d724028d000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1787098082.086062:0:6846:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7227525500 x1873908077701248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787098082.086104:0:6846:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787098082.086199:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077701248:0@lo:8: 00000100:00100000:2.0:1787098082.086332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787098082.086622:0:6846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098082.086627:0:6846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098082.086629:0:6846:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787098082.086632:0:6846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787098082.086636:0:6846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098082.086638:0:6846:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787098082.086640:0:6846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787098082.086642:0:6846:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787098082.086666:0:6846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6846:1873908077701376:0@lo:502: 00000100:00100000:0.0:1787098082.086713:0:6846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098082.086734:0:6846:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209ee5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787098082.086758:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077701248 00000100:00100000:0.0:1787098082.086764:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077701248 00000100:00100000:0.0:1787098082.086797:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787098082.086804:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1873908077701248:12345-0@lo:8: 00010000:00080000:0.0:1787098082.086826:0:6701:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1787098082.086850:0:6701:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b0144535 00002000:00100000:0.0:1787098082.086880:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d72416bd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787098082.086885:0:6701:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787098082.086889:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787098082.087005:0:6701:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787098082.087147:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787098082.087170:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8d72416b9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098082.087237:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1873908077701248:12345-0@lo:8: Request processed in 432us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098082.087245:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787098082.087275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077701376 00000100:00100000:0.0:1787098082.087296:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077701376 00000100:00100000:0.0:1787098082.087326:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787098082.087333:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:6846:x1873908077701376:12345-0@lo:502: 00000100:00100000:0.0:1787098082.088687:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:6846:x1873908077701376:12345-0@lo:502: Request processed in 1348us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098082.088698:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787098082.088703:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077701504:0@lo:400: 00000100:00100000:3.0:1787098082.088750:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787098082.088777:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7227525500 x1873908077701248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787098092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098082.088789:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787098082.088798:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1787098082.088808:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077701632:0@lo:400: 00000100:00080000:0.0:1787098082.088808:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787098082.088816:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787098082.088820:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d724028d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787098082.088836:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787098082.088845:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098082.088857:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077701248:0@lo:8: 00000100:00100000:3.0:1787098082.088896:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077701504 00000100:00100000:3.0:1787098082.088901:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077701504 00000100:00100000:2.0:1787098082.088987:0:6846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:6846:1873908077701376:0@lo:502: 00000020:01000000:2.0:1787098082.089018:0:6846:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098082.089025:0:6846:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098082.089027:0:6846:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787098082.089031:0:6846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787098082.089180:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787098082.089202:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787098082.089211:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.089234:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098082.089245:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787098082.089247:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d7208e14d40 from 1 10000000:01000000:2.0:1787098082.089251:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787098082.089308:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.089323:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.089334:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098082.089349:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077701760:0@lo:101: 00000100:00100000:2.0:1787098082.089390:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098082.089408:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203f39300 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.089777:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077701760 00000100:00100000:2.0:1787098082.089782:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077701760 00000100:00100000:2.0:1787098082.089810:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787098082.089817:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077701760:12345-0@lo:101: 00010000:00010000:2.0:1787098082.089829:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098082.089842:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014453c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.089865:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014453c expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.089875:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014453c expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.089884:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204ee00, rc 0) 00000100:00100000:2.0:1787098082.089916:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077701760:12345-0@lo:101: Request processed in 99us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098082.089922:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787098082.089961:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077701760:0@lo:101: 00010000:00010000:2.0:1787098082.089981:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098082.089990:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098082.090032:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077701888:0@lo:501: 00000100:00100000:2.0:1787098082.090057:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098082.090070:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203f39300 going to sleep for 11 seconds 00000100:00100000:0.0:1787098082.090605:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077701888 00000100:00100000:0.0:1787098082.090611:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077701888 00000100:00100000:0.0:1787098082.090637:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787098082.090645:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077701888:12345-0@lo:501: 00000100:00100000:0.0:1787098082.090837:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077701888:12345-0@lo:501: Request processed in 193us (779us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787098082.090845:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787098082.090882:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077701888:0@lo:501: 10000000:01000000:0.0:1787098082.090906:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787098082.090913:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098082.090928:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098082.091354:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077701632 00000100:00100000:3.0:1787098082.091360:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077701632 00000100:00100000:1.0:1787098082.091376:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787098082.091390:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077701504:12345-0@lo:400: 00000100:00100000:3.0:1787098082.091394:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787098082.091403:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787098082.091548:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077701504:12345-0@lo:400: Request processed in 162us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098082.091557:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787098082.091724:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787098082.091732:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077701632:12345-0@lo:400: 00000100:00100000:1.0:1787098082.091773:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077701632:12345-0@lo:400: Request processed in 41us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098082.091779:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787098082.092130:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787098082.092250:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723b2e1880 x1873908077701504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098082.092264:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077701504:0@lo:400: 00010000:00080000:3.0:1787098082.092313:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723b2e3800 x1873908077701632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098082.092323:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077701632:0@lo:400: 00000004:00080000:3.0:1787098082.092363:0:6851:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787098082.092897:0:6851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 180348615570ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787098082.147067:0:6852:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787098082.147100:0:6852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6852:1873908077702144:0@lo:7: 00000100:00100000:0.0:1787098082.147180:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098082.147243:0:6852:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209ee5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787098082.147265:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077702144 00000100:00100000:0.0:1787098082.147273:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077702144 00000100:00100000:0.0:1787098082.147353:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787098082.147362:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6852:x1873908077702144:12345-0@lo:7: 00000100:00100000:2.0:1787098082.148345:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077702016:0@lo:13: 00000100:00100000:2.0:1787098082.148403:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787098082.148523:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787098082.148557:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077702016 00000100:00100000:3.0:1787098082.148563:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077702016 00000100:00100000:3.0:1787098082.148602:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098082.148611:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1873908077702016:12345-0@lo:13: 00002000:00000024:3.0:1787098082.148635:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787098082.148688:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1873908077702016:12345-0@lo:13: Request processed in 78us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098082.148696:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787098082.148744:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7227525500 x1873908077702016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098082.148763:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077702016:0@lo:13: 00002000:00080000:0.0:1787098082.178514:0:6703:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787098082.178523:0:6703:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:1.0:1787098082.178726:0:6852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7227524000 x1873908077702144/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787098098 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098082.178744:0:6852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6852:1873908077702144:0@lo:7: 00000004:00080000:1.0:1787098082.178766:0:6852:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787098082.178803:0:6852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6852:1873908077702272:0@lo:5: 00000100:00100000:1.0:1787098082.178838:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098082.178879:0:6852:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206417000 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.179016:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787098082.179024:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787098082.179486:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6852:x1873908077702144:12345-0@lo:7: Request processed in 31271us (31453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098082.179502:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787098082.179530:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077702272 00000100:00100000:0.0:1787098082.179537:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077702272 00000100:00100000:0.0:1787098082.179577:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098082.179585:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6852:x1873908077702272:12345-0@lo:5: 00002000:00080000:0.0:1787098082.179615:0:6703:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787098082.179619:0:6703:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:2.0:1787098082.179808:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787098082.180203:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6852:x1873908077702272:12345-0@lo:5: Request processed in 617us (1363us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787098082.180212:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787098082.180417:0:6852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ad41f80 x1873908077702272/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787098098 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098082.180434:0:6852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6852:1873908077702272:0@lo:5: 00000004:00080000:1.0:1787098082.180448:0:6852:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787098082.180483:0:6852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad40a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6852:1873908077702400:0@lo:700: 00000100:00100000:1.0:1787098082.180520:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098082.180609:0:6852:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206417000 going to sleep for 11 seconds 00000100:00100000:2.0:1787098082.180714:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077702400 00000100:00100000:2.0:1787098082.180720:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077702400 00000100:00100000:2.0:1787098082.180788:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787098082.180797:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6852:x1873908077702400:12345-0@lo:700: 00000100:00100000:2.0:1787098082.180828:0:6709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6709:1873908077702528:0@lo:700: 00000100:00100000:2.0:1787098082.180859:0:6709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098082.180885:0:6709:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7220e7c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787098082.180931:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077702528 00000100:00100000:0.0:1787098082.180935:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077702528 00000100:00100000:0.0:1787098082.180978:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787098082.180985:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6709:x1873908077702528:12345-0@lo:700: 40000000:02000000:0.0:1787098082.210495:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787098082.215677:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6709:x1873908077702528:12345-0@lo:700: Request processed in 34682us (34807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098082.215695:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787098082.215777:0:6709:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7207461f80 x1873908077702528/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787098098 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098082.215792:0:6709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6709:1873908077702528:0@lo:700: 40000000:02000000:2.0:1787098082.215805:0:6709:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787098082.291160:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6852:x1873908077702400:12345-0@lo:700: Request processed in 110353us (110627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098082.291192:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1787098082.291244:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787098082.291259:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1787098082.291454:0:6852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ad40a80 x1873908077702400/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787098098 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098082.291484:0:6852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad40a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6852:1873908077702400:0@lo:700: 00000004:02000040:2.0:1787098082.349072:0:6852:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787098082.359017:0:6852:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6852:1873908077702656:0@lo:5: 00000100:00100000:2.0:1787098082.359080:0:6852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098082.359149:0:6852:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72076b8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787098082.359204:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077702656 00000100:00100000:0.0:1787098082.359221:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077702656 00000100:00100000:0.0:1787098082.359271:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787098082.359402:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6852:x1873908077702656:12345-0@lo:5: 00002000:00080000:1.0:1787098082.364802:0:6701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787098082.364827:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787098082.371046:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6852:x1873908077702656:12345-0@lo:5: Request processed in 11760us (11958us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787098082.371061:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787098082.372676:0:6852:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7207461f80 x1873908077702656/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787098098 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098082.372694:0:6852:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787098082.372710:0:6852:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d7207461f80 x1873908077702656/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787098098 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098082.372722:0:6852:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6852:1873908077702656:0@lo:5: 00000004:00080000:2.0:1787098082.372739:0:6852:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787098082.703615:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098083.730411:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098084.752223:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787098085.428586:0:7072:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787098085.779674:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098086.801168:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098087.568323:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077703040:0@lo:400: 00000100:00100000:3.0:1787098087.568385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098087.568448:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787098087.568455:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077703168:0@lo:400: 00000100:00100000:3.0:1787098087.568480:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098087.568480:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077702912:0@lo:400: 00000100:00100000:0.0:1787098087.568509:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098087.568532:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787098087.568538:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077702784:0@lo:400: 00000100:00100000:0.0:1787098087.568567:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098087.568606:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077703040 00000100:00100000:0.0:1787098087.568613:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077703040 00000100:00100000:3.0:1787098087.568628:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077702784 00000100:00100000:3.0:1787098087.568631:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077702784 00000100:00100000:0.0:1787098087.568663:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077702912 00000100:00100000:3.0:1787098087.568666:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787098087.568666:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077702912 00000100:00100000:3.0:1787098087.568673:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3310:x1873908077702784:12345-0@lo:400: 00000100:00100000:0.0:1787098087.568683:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787098087.568689:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077703040:12345-0@lo:400: 00000100:00100000:0.0:1787098087.568747:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077703040:12345-0@lo:400: Request processed in 58us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098087.568754:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787098087.568786:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787098087.568791:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077702912:12345-0@lo:400: 00000100:00100000:0.0:1787098087.568837:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077702912:12345-0@lo:400: Request processed in 46us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098087.568843:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787098087.568860:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787098087.568895:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723b2e1880 x1873908077702912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098087.568908:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077702912:0@lo:400: 00010000:00080000:0.0:1787098087.569073:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723b2e0e00 x1873908077703040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098087.569081:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077703040:0@lo:400: 00000100:00100000:3.0:1787098087.569226:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3310:x1873908077702784:12345-0@lo:400: Request processed in 552us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098087.569233:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787098087.569426:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077703168 00000100:00100000:2.0:1787098087.569430:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077703168 00000100:00100000:2.0:1787098087.569466:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787098087.569473:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1873908077703168:12345-0@lo:400: 00000100:00100000:1.0:1787098087.569498:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077703296:0@lo:13: 00000100:00100000:2.0:1787098087.569513:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1873908077703168:12345-0@lo:400: Request processed in 41us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098087.569520:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787098087.569526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787098087.569551:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098087.569561:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077703296 00000100:00100000:1.0:1787098087.569565:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077703296 00010000:00080000:2.0:1787098087.569577:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723b2e2680 x1873908077703168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098087.569586:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077703168:0@lo:400: 00000100:00100000:1.0:1787098087.569588:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787098087.569594:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873908077703296:12345-0@lo:13: 00002000:00000024:1.0:1787098087.569617:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098087.569666:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873908077703296:12345-0@lo:13: Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098087.569678:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787098087.569751:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077702784:0@lo:400: 00010000:00080000:2.0:1787098087.570549:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7207462a00 x1873908077703296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098087.570565:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077703296:0@lo:13: 00000001:00080000:3.0:1787098087.649118:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787098087.823577:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098088.847590:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098089.871719:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098090.896894:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098091.919533:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098092.687510:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077703808:0@lo:400: 00000100:00100000:3.0:1787098092.687683:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077703680:0@lo:400: 00000100:00100000:0.0:1787098092.687747:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077703424:0@lo:400: 00000100:00100000:3.0:1787098092.690221:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098092.690297:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787098092.690308:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077703552:0@lo:400: 00000100:00100000:3.0:1787098092.690361:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098092.694298:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098092.694348:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077703936:0@lo:13: 00000100:00100000:0.0:1787098092.694377:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098092.694417:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077703680 00000100:00100000:0.0:1787098092.694425:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077703680 00000100:00100000:0.0:1787098092.694468:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077703552 00000100:00100000:0.0:1787098092.694470:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077703552 00000100:00100000:0.0:1787098092.694489:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787098092.694496:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077703680:12345-0@lo:400: 00000100:00100000:0.0:1787098092.694547:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077703680:12345-0@lo:400: Request processed in 51us (4332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098092.694560:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787098092.694581:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787098092.694586:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077703552:12345-0@lo:400: 00000100:00100000:0.0:1787098092.694610:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077703552:12345-0@lo:400: Request processed in 24us (4249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098092.694615:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787098092.694656:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077703424 00000100:00100000:0.0:1787098092.694659:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077703424 00000100:00100000:0.0:1787098092.694676:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787098092.694681:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3310:x1873908077703424:12345-0@lo:400: 00000100:00100000:0.0:1787098092.694707:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3310:x1873908077703424:12345-0@lo:400: Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098092.694713:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787098092.694751:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077703936 00000100:00100000:0.0:1787098092.694753:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077703936 00000100:00100000:0.0:1787098092.694775:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098092.694781:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077703936:12345-0@lo:13: 00002000:00000024:0.0:1787098092.694804:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098092.694828:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077703936:12345-0@lo:13: Request processed in 48us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098092.694833:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787098092.694846:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787098092.694850:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098092.696186:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077703424:0@lo:400: 00010000:00080000:0.0:1787098092.696206:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723b2e1c00 x1873908077703936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098092.696229:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787098092.696252:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077703936:0@lo:13: 00010000:00080000:0.0:1787098092.696593:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7207461c00 x1873908077703552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098092.696604:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077703552:0@lo:400: 00010000:00080000:0.0:1787098092.696617:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7207462680 x1873908077703680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098092.696624:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077703680:0@lo:400: 00000100:00100000:2.0:1787098092.698076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098092.698142:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077703808 00000100:00100000:2.0:1787098092.698150:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077703808 00000100:00100000:2.0:1787098092.698192:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098092.698200:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077703808:12345-0@lo:400: 00000100:00100000:2.0:1787098092.698259:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077703808:12345-0@lo:400: Request processed in 59us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098092.698265:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787098092.698325:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7207460700 x1873908077703808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098092.698338:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077703808:0@lo:400: 00010000:00010000:1.0:1787098092.943410:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098093.969446:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098094.992731:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787098095.960820:0:7643:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787098095.960824:0:7643:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787098095.961037:0:7643:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d7104c23800 00000020:01000004:3.0:1787098095.961052:0:7643:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787098095.961136:0:7643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787098095.961150:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d72065e8000) 00000020:00000080:3.0:1787098095.961165:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787098095.989964:0:7643:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787098095.990223:0:7643:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:1.0:1787098096.015440:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787098096.023956:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787098096.031709:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787098096.031748:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787098096.031945:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787098096.031974:0:7643:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787098096.032619:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787098096.032632:0:7643:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787098096.032642:0:7643:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1d871f9b0144551 00000020:01000004:3.0:1787098096.032650:0:7643:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787098096.032670:0:7643:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787098096.032674:0:7643:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787098096.032679:0:7643:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787098096.032699:0:7643:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787098096.032703:0:7643:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787098096.061666:0:7643:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787098096.061702:0:7643:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787098096.061706:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787098096.061708:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787098096.061709:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787098096.061710:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787098096.061712:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787098096.061713:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787098096.061715:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787098096.061716:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787098096.061717:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787098096.061722:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787098096.061723:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787098096.061726:0:7643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787098096.061728:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787098096.061729:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787098096.061730:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787098096.061731:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787098096.061732:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787098096.061733:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787098096.061734:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787098096.061735:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787098096.061736:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787098096.061737:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787098096.061738:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787098096.061826:0:7643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787098096.061851:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077704064:0@lo:253: 00000100:00100000:2.0:1787098096.061913:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098096.062017:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098096.062092:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077704064 00000100:00100000:3.0:1787098096.062099:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077704064 00000100:00100000:3.0:1787098096.062308:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787098096.062318:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:7643:x1873908077704064:12345-0@lo:253: 20000000:01000000:3.0:1787098096.062347:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787098096.062350:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787098096.062356:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787098096.062368:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787098096.063663:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787098096.064069:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787098096.064084:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787098096.064180:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787098096.064195:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787098096.064512:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787098096.064562:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787098096.065006:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787098096.065027:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:3.0:1787098096.065029:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:3.0:1787098096.065061:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787098096.065068:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787098096.065515:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787098096.065525:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:3.0:1787098096.065560:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787098096.065569:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787098096.065598:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787098096.065649:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787098096.066901:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787098096.066928:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:3.0:1787098096.066929:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:3.0:1787098096.066964:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787098096.066971:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787098096.067001:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787098096.067008:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:3.0:1787098096.067054:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787098096.067062:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787098096.067435:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787098096.067501:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787098096.067519:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787098096.067522:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787098096.067529:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787098096.067531:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787098096.067533:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787098096.067546:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787098096.067556:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787098096.067598:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787098096.067602:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787098096.068651:0:7645:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787098096.068714:0:7645:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787098096.068864:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787098096.069249:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787098096.069547:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787098096.069589:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787098096.069603:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787098096.069605:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787098096.070065:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787098096.070272:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787098096.070346:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787098096.070433:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787098096.070447:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787098096.070449:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787098096.072352:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787098096.072434:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787098096.072487:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787098096.073026:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787098096.073070:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787098096.073155:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787098096.073169:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787098096.073172:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787098096.074929:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787098096.075018:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787098096.075054:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787098096.075571:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787098096.075615:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787098096.075671:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1787098096.075689:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787098096.075712:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.075747:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01444a2 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.075828:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01444cc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.075844:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01444f6 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.075851:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144512 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.075858:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014453c expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.075865:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.075909:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b014453c expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.075926:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b014453c expref: 16 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098096.075942:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704192:0@lo:104: 00000100:00100000:0.0:1787098096.076015:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787098096.076124:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144512 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.076132:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144512 expref: 16 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098096.076150:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704320:0@lo:104: 00010000:00010000:0.0:1787098096.076179:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01444f6 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.076187:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01444f6 expref: 16 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098096.076196:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704448:0@lo:104: 00010000:00010000:0.0:1787098096.076220:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01444cc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.076228:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01444cc expref: 16 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098096.076236:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704576:0@lo:104: 00010000:00010000:0.0:1787098096.076259:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01444a2 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.076267:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01444a2 expref: 16 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098096.076275:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704704:0@lo:104: 00000100:00100000:0.0:1787098096.076332:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098096.076547:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787098096.076567:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.076642:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.076705:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098096.076726:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077704192 00000100:00100000:1.0:1787098096.076734:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077704192 00000100:00100000:1.0:1787098096.076780:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077704320 00000100:00100000:1.0:1787098096.076783:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077704320 00000100:00100000:1.0:1787098096.076794:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077704448 00000100:00100000:1.0:1787098096.076797:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077704448 00000100:00100000:1.0:1787098096.076809:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787098096.076817:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72087c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:5836:x1873908077704192:12345-0@lo:104: 00010000:00010000:1.0:1787098096.076831:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.076914:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787098096.076920:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72087c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:5836:x1873908077704192:12345-0@lo:104: Request processed in 104us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.076928:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787098096.076968:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787098096.076974:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:5836:x1873908077704320:12345-0@lo:104: 00010000:00010000:1.0:1787098096.076982:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077017:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787098096.077023:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:5836:x1873908077704320:12345-0@lo:104: Request processed in 50us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.077040:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787098096.077054:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787098096.077061:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5836:x1873908077704448:12345-0@lo:104: 00010000:00010000:1.0:1787098096.077069:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077114:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787098096.077119:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5836:x1873908077704448:12345-0@lo:104: Request processed in 59us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.077126:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787098096.077142:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787098096.077148:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077155:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204f000 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098096.077159:0:6716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077168:0:6716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098096.077175:0:6716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098096.077181:0:6716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787098096.077211:0:6716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077217:0:6716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098096.077241:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077248:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014453c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144543 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077263:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787098096.077266:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077272:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f090a00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098096.077275:0:6716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077307:0:6716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098096.077313:0:6716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098096.077318:0:6716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787098096.077331:0:6716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077336:0:6716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098096.077342:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.077348:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b0144512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144519 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.077453:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098096.077459:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.077466:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e800 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098096.077469:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.077476:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098096.077482:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098096.077488:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787098096.077504:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.077517:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098096.077534:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.077541:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204e800/0xb1d871f9b01444f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444fd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.077553:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098096.077555:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098096.077557:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098096.077571:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077705088:0@lo:103: 00000100:00100000:2.0:1787098096.077617:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787098096.077811:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098096.077818:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098096.077820:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098096.077849:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077704832:0@lo:103: 00000100:00100000:1.0:1787098096.077876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098096.077974:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704192:0@lo:104: 00000100:00100000:0.0:1787098096.077985:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704320:0@lo:104: 00000100:00100000:0.0:1787098096.077991:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704448:0@lo:104: 00000100:00100000:1.0:1787098096.078042:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787098096.078049:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077704960:0@lo:103: 00000100:00100000:1.0:1787098096.078069:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098096.078330:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077705088 00000100:00100000:2.0:1787098096.078337:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077705088 00010000:00010000:2.0:1787098096.078638:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01444f6 expref: 17 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098096.078662:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077704832 00000100:00100000:2.0:1787098096.078666:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077704832 00010000:00010000:2.0:1787098096.078678:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014453c expref: 18 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098096.078689:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077704960 00000100:00100000:2.0:1787098096.078691:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077704960 00010000:00010000:2.0:1787098096.078699:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144512 expref: 19 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098096.078709:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787098096.078716:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077705088:12345-0@lo:103: 00010000:00010000:2.0:1787098096.078737:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098096.078744:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01444f6 expref: 19 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.078822:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01444f6 expref: 19 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.078851:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f090200/0xb1d871f9b01444fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01444f6 expref: 19 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.078867:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098096.078905:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:3309:x1873908077705088:12345-0@lo:103: Request processed in 190us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.078912:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787098096.078927:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787098096.078933:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:3311:x1873908077704832:12345-0@lo:103: 00010000:00010000:2.0:1787098096.078940:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098096.078945:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014453c expref: 17 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.078954:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b014453c expref: 17 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.078964:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0144543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b014453c expref: 17 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.078973:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098096.078997:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3311:x1873908077704832:12345-0@lo:103: Request processed in 64us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.079003:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787098096.079018:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787098096.079024:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:3311:x1873908077704960:12345-0@lo:103: 00010000:00010000:2.0:1787098096.079030:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098096.079034:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144512 expref: 15 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.079043:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144512 expref: 15 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.079052:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204fa00/0xb1d871f9b0144519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144512 expref: 15 pid: 5839 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.079062:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098096.079079:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3311:x1873908077704960:12345-0@lo:103: Request processed in 56us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.079085:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787098096.079177:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077705088:0@lo:103: 00000100:00100000:1.0:1787098096.079258:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077704960:0@lo:103: 00000100:00100000:1.0:1787098096.079266:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077704832:0@lo:103: 00010000:00010000:1.0:1787098096.079300:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098096.080994:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.081012:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077704576 00000100:00100000:3.0:1787098096.081018:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077704576 00000100:00100000:3.0:1787098096.081050:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077704704 00000100:00100000:3.0:1787098096.081053:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077704704 00000100:00100000:1.0:1787098096.081054:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787098096.081065:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:5836:x1873908077704576:12345-0@lo:104: 00010000:00010000:1.0:1787098096.081081:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.081259:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787098096.081266:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:5836:x1873908077704576:12345-0@lo:104: Request processed in 203us (4560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.081274:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787098096.081308:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787098096.081314:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5836:x1873908077704704:12345-0@lo:104: 00010000:00010000:1.0:1787098096.081322:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.081354:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1787098096.081437:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787098096.081444:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081452:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204ea00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098096.081457:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081465:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098096.081473:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098096.081491:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787098096.081525:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081532:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098096.081546:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081553:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204ea00/0xb1d871f9b01444cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444d3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081565:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098096.081567:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081573:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030400 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098096.081576:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081583:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098096.081589:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098096.081594:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787098096.081602:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081607:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098096.081622:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081628:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7200030400/0xb1d871f9b01444a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444a9 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081641:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098096.081643:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098096.081644:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098096.081656:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077705216:0@lo:103: 00000100:00100000:2.0:1787098096.081691:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098096.081732:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077705216 00000100:00100000:2.0:1787098096.081736:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077705216 00010000:00010000:2.0:1787098096.081752:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01444cc expref: 14 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098096.081784:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787098096.081790:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3310:x1873908077705216:12345-0@lo:103: 00010000:00010000:2.0:1787098096.081800:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098096.081805:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01444cc expref: 14 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081814:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01444cc expref: 14 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.081830:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098096.081862:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3310:x1873908077705216:12345-0@lo:103: Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.081868:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787098096.081895:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077705216:0@lo:103: 00000100:00100000:1.0:1787098096.081991:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5836:x1873908077704704:12345-0@lo:104: Request processed in 676us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.082004:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787098096.082028:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077705344:0@lo:103: 00000100:00100000:1.0:1787098096.082051:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787098096.082084:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098096.082091:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077705344 00000100:00100000:1.0:1787098096.082094:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077705344 00010000:00010000:1.0:1787098096.082197:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01444a2 expref: 14 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098096.082219:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787098096.082226:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3311:x1873908077705344:12345-0@lo:103: 00010000:00010000:1.0:1787098096.082233:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098096.082236:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01444a2 expref: 14 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082250:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01444a2 expref: 14 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082262:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082271:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082303:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082311:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082328:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082335:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082340:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098096.082344:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082352:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082460:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.082472:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098096.082510:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3311:x1873908077705344:12345-0@lo:103: Request processed in 283us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.082516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787098096.082573:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077705344:0@lo:103: 00010000:00010000:0.0:1787098096.082656:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c7000/0xb1d871f9b01444d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01444cc expref: 13 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098096.082672:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704576:0@lo:104: 00010000:00010000:0.0:1787098096.082682:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b01444a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01444a2 expref: 12 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098096.082691:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5836:1873908077704704:0@lo:104: 00010000:00010000:0.0:1787098096.082711:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.082719:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.082725:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.082731:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144558 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787098096.082744:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787098096.134116:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:7643:x1873908077704064:12345-0@lo:253: Request processed in 71778us (72182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.134132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787098096.134321:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077704064:0@lo:253: 10000000:01000000:3.0:1787098096.134337:0:7643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787098096.134340:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787098096.134342:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787098096.134344:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787098096.134345:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787098096.134346:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787098096.134348:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787098096.134350:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787098096.134351:0:7643:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787098096.134369:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787098096.134370:0:7643:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787098096.134390:0:7643:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d7104c23800 from lustre-OST0001 10000000:01000000:3.0:1787098096.134416:0:7643:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787098096.134419:0:7643:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787098096.134427:0:7643:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d7208e14d40 local copy 10000000:01000000:3.0:1787098096.134431:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787098096.134470:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.134482:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.134491:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098096.134513:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077705472:0@lo:101: 00000100:00100000:3.0:1787098096.134555:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.134623:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098096.134780:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077705472 00000100:00100000:1.0:1787098096.134786:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077705472 00000100:00100000:1.0:1787098096.134845:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787098096.134856:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+11:7643:x1873908077705472:12345-0@lo:101: 00010000:00010000:1.0:1787098096.134869:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098096.134883:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014455f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.134906:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014455f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.134924:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014455f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.134934:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d720f090a00, rc 0) 00000100:00100000:1.0:1787098096.134984:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077705472:12345-0@lo:101: Request processed in 131us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.134991:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787098096.135207:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077705472:0@lo:101: 00010000:00010000:3.0:1787098096.135220:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.135230:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098096.135354:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077705600:0@lo:501: 00000100:00100000:3.0:1787098096.135382:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.135414:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787098096.135472:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077705600 00000100:00100000:2.0:1787098096.135477:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077705600 00000100:00100000:2.0:1787098096.135508:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787098096.135515:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077705600:12345-0@lo:501: 00000100:00100000:2.0:1787098096.135723:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077705600:12345-0@lo:501: Request processed in 207us (339us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787098096.135730:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787098096.135805:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077705600:0@lo:501: 10000000:01000000:3.0:1787098096.135826:0:7643:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787098096.135863:0:7643:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787098096.135868:0:7643:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.135877:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.135884:0:7643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.135910:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787098096.135928:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d7104c23800 10000000:01000000:3.0:1787098096.135933:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787098096.135938:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787098096.135952:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787098096.135957:0:7643:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787098096.135959:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787098096.135976:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.135983:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.135992:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098096.136005:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077705728:0@lo:101: 00000100:00100000:3.0:1787098096.136031:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.136053:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787098096.136226:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077705728 00000100:00100000:2.0:1787098096.136231:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077705728 00000100:00100000:2.0:1787098096.136266:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787098096.136273:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077705728:12345-0@lo:101: 00010000:00010000:2.0:1787098096.136301:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098096.136313:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014456d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.136331:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014456d expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.136341:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014456d expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.136348:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204ea00, rc 0) 00000100:00100000:2.0:1787098096.136379:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077705728:12345-0@lo:101: Request processed in 106us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.136391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:2.0:1787098096.136415:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098096.136421:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.136429:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6c00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098096.136433:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.136442:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098096.136449:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098096.136455:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787098096.136473:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.136479:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098096.136499:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.136506:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d72421c6c00/0xb1d871f9b014455f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb1d871f9b0144566 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.136521:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098096.136523:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098096.136525:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098096.136536:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077705856:0@lo:103: 00000100:00100000:2.0:1787098096.136570:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098096.136613:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077705856 00000100:00100000:2.0:1787098096.136617:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077705856 00000100:00100000:2.0:1787098096.136646:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098096.136653:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:3312:x1873908077705856:12345-0@lo:103: 00010000:00010000:2.0:1787098096.136662:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098096.136674:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f090a00/0xb1d871f9b0144566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b014455f expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.136684:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098096.136712:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:3312:x1873908077705856:12345-0@lo:103: Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.136719:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098096.136747:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077705856:0@lo:103: 00000100:00100000:3.0:1787098096.136819:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077705728:0@lo:101: 00010000:00010000:3.0:1787098096.136831:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.136849:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098096.136927:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077705984:0@lo:501: 00000100:00100000:3.0:1787098096.136968:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.136991:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787098096.137094:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077705984 00000100:00100000:2.0:1787098096.137098:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077705984 00000100:00100000:2.0:1787098096.137198:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787098096.137205:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077705984:12345-0@lo:501: 00000100:00100000:2.0:1787098096.137438:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077705984:12345-0@lo:501: Request processed in 233us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.137445:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787098096.137529:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077705984:0@lo:501: 00000100:00100000:3.0:1787098096.137558:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706112:0@lo:503: 00000100:00100000:3.0:1787098096.137595:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.137622:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787098096.137670:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077706112 00000100:00100000:2.0:1787098096.137674:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077706112 00000100:00100000:2.0:1787098096.137702:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787098096.137708:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077706112:12345-0@lo:503: 00000100:00100000:2.0:1787098096.137870:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077706112:12345-0@lo:503: Request processed in 161us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.137887:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787098096.138012:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706112:0@lo:503: 00000040:00080000:2.0:1787098096.138911:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787098096.139045:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706240:0@lo:502: 00000100:00100000:2.0:1787098096.139169:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098096.139209:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787098096.139274:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077706240 00000100:00100000:0.0:1787098096.139301:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077706240 00000100:00100000:0.0:1787098096.139392:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787098096.139402:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077706240:12345-0@lo:502: 00000100:00100000:0.0:1787098096.139591:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077706240:12345-0@lo:502: Request processed in 190us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098096.139599:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787098096.139684:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706240:0@lo:502: 00000040:00080000:2.0:1787098096.139997:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787098096.140046:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787098096.140079:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787098096.140138:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787098096.140175:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787098096.140209:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787098096.140237:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706368:0@lo:502: 00000100:00100000:2.0:1787098096.140316:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098096.140676:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098096.140767:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077706368 00000100:00100000:1.0:1787098096.140773:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077706368 00000100:00100000:1.0:1787098096.140806:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787098096.140814:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077706368:12345-0@lo:502: 00000100:00100000:1.0:1787098096.141026:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077706368:12345-0@lo:502: Request processed in 211us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.141033:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787098096.141222:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706368:0@lo:502: 00000040:00080000:2.0:1787098096.141370:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787098096.141382:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787098096.141735:0:7650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787098096.141743:0:7650:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787098096.141750:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098096.141753:0:7650:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787098096.141758:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787098096.141773:0:7650:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d720655cd40) 00000020:00000080:2.0:1787098096.141808:0:7650:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787098096.141815:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787098096.141891:0:7650:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7104c23800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787098096.141898:0:7650:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787098096.141904:0:7650:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1d871f9b0144582 00010000:00010000:2.0:1787098096.147810:0:7650:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787098096.148498:0:7650:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787098096.151398:0:7650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787098096.151722:0:7650:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787098096.156231:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787098096.157460:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787098096.159478:0:7650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787098096.159497:0:7650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098096.159505:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098096.159508:0:7650:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787098096.159512:0:7650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787098096.159516:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098096.159518:0:7650:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787098096.159520:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787098096.159523:0:7650:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787098096.159575:0:7650:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098096.159578:0:7650:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098096.159579:0:7650:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787098096.159582:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787098096.159756:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787098096.159782:0:7643:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787098096.159801:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.159814:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098096.159822:0:7643:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7104c23800 from 1 10000000:01000000:2.0:1787098096.159824:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787098096.159888:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.159896:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098096.159907:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098096.159931:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706496:0@lo:101: 00000100:00100000:2.0:1787098096.160195:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098096.160246:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723d3eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787098096.160318:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077706496 00000100:00100000:0.0:1787098096.160327:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077706496 00000100:00100000:0.0:1787098096.160369:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787098096.160378:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:7643:x1873908077706496:12345-0@lo:101: 00010000:00010000:0.0:1787098096.160391:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098096.160404:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144589 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.160427:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144589 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.160438:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144589 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.160447:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200031200, rc 0) 00000100:00100000:0.0:1787098096.160550:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077706496:12345-0@lo:101: Request processed in 172us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098096.160557:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787098096.163471:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706496:0@lo:101: 00010000:00010000:3.0:1787098096.163505:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.163518:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098096.163686:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706624:0@lo:501: 00000100:00100000:3.0:1787098096.163750:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098096.163857:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077706624 00000100:00100000:0.0:1787098096.163871:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077706624 00000100:00100000:0.0:1787098096.163917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787098096.163926:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077706624:12345-0@lo:501: 00000100:00100000:0.0:1787098096.164185:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077706624:12345-0@lo:501: Request processed in 259us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098096.164193:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787098096.168062:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787098096.168183:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706624:0@lo:501: 00000100:00100000:3.0:1787098096.168242:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706752:0@lo:503: 00000100:00100000:3.0:1787098096.168432:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.168517:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787098096.171594:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077706752 00000100:00100000:2.0:1787098096.171611:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077706752 00000100:00100000:2.0:1787098096.171672:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787098096.171681:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077706752:12345-0@lo:503: 00000100:00100000:2.0:1787098096.172375:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077706752:12345-0@lo:503: Request processed in 692us (3940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.172385:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787098096.172489:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706752:0@lo:503: 00000040:00080000:3.0:1787098096.172781:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787098096.172868:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706880:0@lo:502: 00000100:00100000:3.0:1787098096.172919:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.172970:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787098096.173123:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077706880 00000100:00100000:0.0:1787098096.173129:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077706880 00000100:00100000:0.0:1787098096.173168:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787098096.173177:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077706880:12345-0@lo:502: 00000100:00100000:0.0:1787098096.173380:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077706880:12345-0@lo:502: Request processed in 204us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098096.173387:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787098096.173587:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077706880:0@lo:502: 00000040:00080000:2.0:1787098096.173853:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787098096.173903:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787098096.173933:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707008:0@lo:502: 00000100:00100000:2.0:1787098096.174061:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098096.174156:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723d3eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787098096.174243:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077707008 00000100:00100000:0.0:1787098096.174248:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077707008 00000100:00100000:0.0:1787098096.174305:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787098096.174313:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077707008:12345-0@lo:502: 00000100:00100000:0.0:1787098096.174458:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077707008:12345-0@lo:502: Request processed in 146us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098096.174466:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787098096.174544:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707008:0@lo:502: 00000040:00080000:3.0:1787098096.174627:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787098096.174637:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787098096.177876:0:7654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787098096.177891:0:7654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098096.177893:0:7654:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787098096.177903:0:7654:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7104c23800 00000020:00000080:3.0:1787098096.177905:0:7654:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787098096.177927:0:7654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787098096.177930:0:7654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098096.177931:0:7654:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787098096.177934:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787098096.178242:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787098096.178266:0:7643:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787098096.178434:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.178446:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098096.178517:0:7643:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787098096.178520:0:7643:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d7104c23800 10000000:01000000:0.0:1787098096.178524:0:7643:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d7104c23800 10000000:01000000:0.0:1787098096.178529:0:7643:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787098096.178535:0:7643:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d7104c23800 from 1 10000000:01000000:0.0:1787098096.178537:0:7643:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787098096.178572:0:7643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.178580:0:7643:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098096.178591:0:7643:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098096.178618:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707136:0@lo:101: 00000100:00100000:0.0:1787098096.178683:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098096.178736:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098096.178795:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077707136 00000100:00100000:1.0:1787098096.178803:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077707136 00000100:00100000:1.0:1787098096.178859:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787098096.178868:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077707136:12345-0@lo:101: 00010000:00010000:1.0:1787098096.178881:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098096.178895:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144597 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.178919:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144597 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.178929:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144597 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.178962:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d720f090800, rc 0) 00000100:00100000:1.0:1787098096.179005:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077707136:12345-0@lo:101: Request processed in 138us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.179011:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787098096.179059:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707136:0@lo:101: 00010000:00010000:1.0:1787098096.179071:0:7643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.179079:0:7643:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098096.179326:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707264:0@lo:501: 00000100:00100000:1.0:1787098096.179353:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098096.179368:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828540 going to sleep for 11 seconds 00000100:00100000:2.0:1787098096.179443:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077707264 00000100:00100000:2.0:1787098096.179448:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077707264 00000100:00100000:2.0:1787098096.179480:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787098096.179487:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077707264:12345-0@lo:501: 00000100:00100000:2.0:1787098096.179707:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077707264:12345-0@lo:501: Request processed in 219us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.179714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787098096.179751:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707264:0@lo:501: 00000100:00100000:2.0:1787098096.179781:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707392:0@lo:503: 00000100:00100000:2.0:1787098096.179818:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098096.179854:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203d5a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098096.179868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077707392 00000100:00100000:2.0:1787098096.179871:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077707392 00000100:00100000:2.0:1787098096.179896:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787098096.179902:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077707392:12345-0@lo:503: 00000100:00100000:2.0:1787098096.180382:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077707392:12345-0@lo:503: Request processed in 477us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.180390:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787098096.180544:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707392:0@lo:503: 00000040:00080000:1.0:1787098096.180886:0:7643:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787098096.181027:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707520:0@lo:502: 00000100:00100000:1.0:1787098096.181075:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098096.181226:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72068283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098096.181269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077707520 00000100:00100000:3.0:1787098096.181274:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077707520 00000100:00100000:3.0:1787098096.181603:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787098096.181613:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077707520:12345-0@lo:502: 00000100:00100000:3.0:1787098096.181880:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077707520:12345-0@lo:502: Request processed in 268us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098096.181888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787098096.182040:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707520:0@lo:502: 00000040:00080000:1.0:1787098096.182591:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787098096.182653:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787098096.182689:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787098096.182752:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787098096.182795:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787098096.182867:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787098096.182907:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787098096.183087:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787098096.183232:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787098096.183274:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787098096.183751:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787098096.183808:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787098096.183859:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787098096.183897:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787098096.184020:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787098096.184061:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787098096.184170:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787098096.184230:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787098096.184268:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787098096.184456:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787098096.184509:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787098096.184546:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787098096.184581:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787098096.184629:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787098096.184665:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787098096.184702:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787098096.184771:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787098096.184805:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787098096.184844:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787098096.184905:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787098096.185018:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787098096.185058:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787098096.185188:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787098096.185243:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787098096.185568:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787098096.185637:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787098096.185677:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787098096.185726:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707648:0@lo:502: 00000100:00100000:0.0:1787098096.185800:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098096.185902:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73480 going to sleep for 11 seconds 00000100:00100000:2.0:1787098096.186023:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077707648 00000100:00100000:2.0:1787098096.186030:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077707648 00000100:00100000:2.0:1787098096.186120:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787098096.186129:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077707648:12345-0@lo:502: 00000100:00100000:2.0:1787098096.186389:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077707648:12345-0@lo:502: Request processed in 260us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098096.186399:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787098096.186498:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077707648:0@lo:502: 00000040:00080000:3.0:1787098096.186582:0:7643:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787098096.186601:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787098096.187372:0:7655:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787098096.187386:0:7655:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d723bac3380) 00000020:00000080:1.0:1787098096.187412:0:7655:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787098096.189792:0:7655:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7104c23800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787098096.189808:0:7655:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7104c23800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787098096.189812:0:7655:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7104c23800 3 00010000:00080000:1.0:1787098096.189865:0:7655:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7241aaf800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1787098096.197205:0:7655:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787098096.197350:0:7655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787098096.197394:0:7655:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787098096.197408:0:7655:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb1d871f9b01445ac 00000100:00080000:1.0:1787098096.197422:0:7655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787098096.197429:0:7655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d7241aaf800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1787098096.197471:0:7655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723ad41180 x1873908077707776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787098096.197510:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1873908077707776:0@lo:38: 00000100:00100000:1.0:1787098096.197582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098096.197651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077707776 00000100:00100000:1.0:1787098096.197661:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077707776 00000100:00100000:1.0:1787098096.197692:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787098096.197699:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1873908077707776:12345-0@lo:38: 00010000:00080000:1.0:1787098096.197723:0:5843:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1787098096.197753:0:5843:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb1d871f9b01445b3 00000004:00100000:1.0:1787098096.197768:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787098096.197799:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d7241aac000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098096.197865:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873908077707776:12345-0@lo:38: Request processed in 163us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.197873:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787098096.197911:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ad41180 x1873908077707776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787098106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098096.197921:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787098096.197939:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787098096.197946:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787098096.197950:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787098096.197952:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7241aaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787098096.197958:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1873908077707776:0@lo:38: 00000100:00080000:1.0:1787098096.197979:0:7655:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1787098096.198977:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787098096.199233:0:7643:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787098096.199258:0:7643:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787098096.199307:0:7643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.199319:0:7643:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787098096.199375:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787098096.199377:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787098096.199379:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787098096.199380:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787098096.199381:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787098096.199383:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787098096.199384:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787098096.199386:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787098096.199387:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787098096.199389:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787098096.199390:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787098096.199394:0:7643:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787098096.199397:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787098096.199398:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787098096.199400:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787098096.199401:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787098096.199402:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787098096.199403:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787098096.199404:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787098096.199405:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787098096.199406:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787098096.199407:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787098096.199408:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787098096.199427:0:7643:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787098096.199443:0:7643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077708032:0@lo:253: 00000100:00100000:3.0:1787098096.199498:0:7643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.199534:0:7643:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098096.199564:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077708032 00000100:00100000:3.0:1787098096.199570:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077708032 00000100:00100000:3.0:1787098096.199610:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787098096.199619:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:7643:x1873908077708032:12345-0@lo:253: 20000000:01000000:3.0:1787098096.199658:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787098096.199674:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787098096.200370:0:7657:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e0e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7657:1873908077708160:0@lo:901: 00000100:00100000:3.0:1787098096.200412:0:7657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.200455:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077708160 00000100:00100000:3.0:1787098096.200459:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077708160 00000100:00100000:3.0:1787098096.200500:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098096.200507:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7657:x1873908077708160:12345-0@lo:901: 00000100:00100000:3.0:1787098096.200779:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7657:x1873908077708160:12345-0@lo:901: Request processed in 271us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098096.200787:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787098096.200807:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098096.200819:0:7657:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7ea80 going to sleep for 11 seconds 00010000:00080000:3.0:1787098096.200851:0:7657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723b2e0e00 x1873908077708160/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787098112 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098096.200865:0:7657:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e0e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7657:1873908077708160:0@lo:901: 00000100:00100000:3.0:1787098096.203478:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787098096.205829:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077708288:0@lo:400: 00000100:00100000:3.0:1787098096.205914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.205959:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077707904:0@lo:400: 00000100:00100000:3.0:1787098096.205982:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098096.206340:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077708416:0@lo:400: 00000100:00100000:1.0:1787098096.206373:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098096.206415:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077708416 00000100:00100000:1.0:1787098096.206424:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077708416 00000100:00100000:1.0:1787098096.206484:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787098096.206498:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077708416:12345-0@lo:400: 00000100:00100000:1.0:1787098096.206549:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077708416:12345-0@lo:400: Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.206557:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787098096.206593:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ad40a80 x1873908077708416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098096.206608:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077708416:0@lo:400: 00000100:00100000:0.0:1787098096.207277:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077708288 00000100:00100000:0.0:1787098096.207305:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077708288 00000100:00100000:0.0:1787098096.207340:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077707904 00000100:00100000:0.0:1787098096.207343:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077707904 00000100:00100000:0.0:1787098096.207388:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787098096.207397:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077708288:12345-0@lo:400: 00000100:00100000:0.0:1787098096.207466:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077708288:12345-0@lo:400: Request processed in 71us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098096.207473:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787098096.207487:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787098096.207493:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077707904:12345-0@lo:400: 00000100:00100000:0.0:1787098096.207520:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077707904:12345-0@lo:400: Request processed in 28us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098096.207527:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787098096.207620:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787098096.207626:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787098096.207661:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ad41f80 x1873908077708288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098096.207673:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077708288:0@lo:400: 00010000:00080000:3.0:1787098096.207683:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ad41180 x1873908077707904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098096.207692:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077707904:0@lo:400: 20000000:01000000:3.0:1787098096.231454:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787098096.231472:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787098096.231525:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787098096.231531:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787098096.231554:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.231574:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144504 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.231583:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.231636:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144504 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098096.231651:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144504 expref: 14 pid: 5836 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098096.231666:0:5859:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad40a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1873908077708544:0@lo:104: 00000100:00100000:1.0:1787098096.231725:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098096.231766:0:5859:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722807f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787098096.231828:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077708544 00000100:00100000:3.0:1787098096.231845:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077708544 00000100:00100000:3.0:1787098096.231897:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787098096.231906:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5859:x1873908077708544:12345-0@lo:104: 00010000:00010000:3.0:1787098096.231919:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.231980:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098096.231986:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:5859:x1873908077708544:12345-0@lo:104: Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098096.231993:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787098096.232029:0:5859:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad40a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1873908077708544:0@lo:104: 00010000:00010000:3.0:1787098096.232048:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232065:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098096.232070:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232077:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f091a00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098096.232088:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232096:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098096.232263:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098096.232269:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787098096.232323:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232330:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098096.232348:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232355:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d720f091a00/0xb1d871f9b0144504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014450b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232373:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098096.232375:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098096.232377:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098096.232388:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077708672:0@lo:103: 00000100:00100000:3.0:1787098096.232420:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098096.232462:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077708672 00000100:00100000:3.0:1787098096.232466:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077708672 00010000:00010000:3.0:1787098096.232483:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144504 expref: 15 pid: 5836 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098096.232503:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787098096.232517:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d721fa9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:3312:x1873908077708672:12345-0@lo:103: 00010000:00010000:3.0:1787098096.232527:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098096.232533:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144504 expref: 15 pid: 5836 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232541:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144504 expref: 15 pid: 5836 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232555:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6000/0xb1d871f9b014450b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144504 expref: 15 pid: 5836 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232568:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232576:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787098096.232588:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001294412s 00010000:00010000:3.0:1787098096.232592:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232599:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232606:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232613:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232618:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f090a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098096.232628:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232636:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232649:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232659:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098096.232690:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d721fa9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3312:x1873908077708672:12345-0@lo:103: Request processed in 174us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098096.232697:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787098096.232743:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232750:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098096.232757:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f090a00/0xb1d871f9b01445ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098096.232783:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077708672:0@lo:103: 00000100:00100000:1.0:1787098096.240786:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:7643:x1873908077708032:12345-0@lo:253: Request processed in 41155us (41274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098096.240803:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787098096.240920:0:7643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af6522d0-d61c-40bd-bd34-bb282ba82d15:7643:1873908077708032:0@lo:253: 10000000:01000000:3.0:1787098096.240936:0:7643:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787098096.240949:0:7643:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787098096.240950:0:7643:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787098096.240952:0:7643:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787098096.240953:0:7643:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787098096.240955:0:7643:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787098096.240956:0:7643:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787098096.240970:0:7643:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787098096.240971:0:7643:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787098096.240973:0:7643:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787098096.240975:0:7643:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787098096.240976:0:7643:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787098096.240994:0:7643:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787098096.246004:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787098096.246349:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787098096.246565:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787098096.246743:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787098096.246942:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787098096.247599:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787098096.249517:0:7643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787098096.507328:0:7643:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787098096.507336:0:7643:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787098096.507373:0:7643:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787098096.507429:0:7643:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787098096.507444:0:7643:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787098096.507476:0:7643:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787098097.039432:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098097.807531:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077708800:0@lo:13: 00000100:00100000:1.0:1787098097.807599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098097.807747:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077708800 00000100:00100000:0.0:1787098097.807757:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077708800 00000100:00100000:0.0:1787098097.807820:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787098097.807830:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077708800:12345-0@lo:13: 00002000:00000024:0.0:1787098097.807866:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098097.807925:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077708800:12345-0@lo:13: Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098097.807933:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787098097.807976:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525f80 x1873908077708800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098097.807996:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077708800:0@lo:13: 00010000:00010000:2.0:1787098098.071866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098099.092852:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098100.111624:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098101.135597:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098101.402154:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077708928:0@lo:400: 00000100:00100000:3.0:1787098101.402233:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098101.402319:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077709440:0@lo:400: 00000100:00100000:3.0:1787098101.402345:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098101.402369:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787098101.402375:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077709312:0@lo:400: 00000100:00100000:3.0:1787098101.402395:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098101.402420:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077709056:0@lo:400: 00000100:00100000:3.0:1787098101.402440:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098101.402455:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787098101.402467:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077709184:0@lo:400: 00000100:00100000:3.0:1787098101.402489:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098101.402524:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077708928 00000100:00100000:3.0:1787098101.402531:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077708928 00000100:00100000:3.0:1787098101.402574:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787098101.402582:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:3310:x1873908077708928:12345-0@lo:400: 00000100:00100000:3.0:1787098101.402632:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:3310:x1873908077708928:12345-0@lo:400: Request processed in 50us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098101.402639:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787098101.402674:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077709312 00000100:00100000:3.0:1787098101.402678:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077709312 00000100:00100000:3.0:1787098101.402713:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787098101.402719:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077709312:12345-0@lo:400: 00000100:00100000:3.0:1787098101.402899:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077709312:12345-0@lo:400: Request processed in 179us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098101.402906:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787098101.402927:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787098101.402956:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f92300 x1873908077709312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098101.402969:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077709312:0@lo:400: 00000100:00100000:3.0:1787098101.402978:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077708928:0@lo:400: 00000100:00100000:2.0:1787098101.403766:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077709440 00000100:00100000:2.0:1787098101.403774:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077709440 00000100:00100000:2.0:1787098101.403956:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077709056 00000100:00100000:2.0:1787098101.403961:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077709056 00000100:00100000:2.0:1787098101.403980:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077709184 00000100:00100000:2.0:1787098101.403983:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077709184 00000100:00100000:2.0:1787098101.404001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787098101.404009:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077709440:12345-0@lo:400: 00000100:00100000:2.0:1787098101.404082:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077709440:12345-0@lo:400: Request processed in 74us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098101.404090:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787098101.404104:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787098101.404111:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077709056:12345-0@lo:400: 00000100:00100000:2.0:1787098101.404142:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077709056:12345-0@lo:400: Request processed in 32us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098101.404162:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787098101.404175:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787098101.404181:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077709184:12345-0@lo:400: 00000100:00100000:2.0:1787098101.404213:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077709184:12345-0@lo:400: Request processed in 32us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098101.404219:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787098101.404359:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787098101.404389:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f91f80 x1873908077709184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098101.404402:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077709184:0@lo:400: 00010000:00080000:3.0:1787098101.404414:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b2e1c00 x1873908077709056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098101.404432:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077709056:0@lo:400: 00010000:00080000:3.0:1787098101.404466:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f91880 x1873908077709440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098101.404476:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077709440:0@lo:400: 00010000:00010000:3.0:1787098102.165488:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787098102.182103:0:7998:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787098102.928748:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787098102.928776:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077709568:0@lo:13: 00000100:00100000:0.0:1787098102.928849:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098102.928916:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077709568 00000100:00100000:0.0:1787098102.928923:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077709568 00000100:00100000:0.0:1787098102.928983:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787098102.929001:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077709568:12345-0@lo:13: 00002000:00000024:0.0:1787098102.929038:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098102.929083:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077709568:12345-0@lo:13: Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098102.929090:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787098102.929133:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525f80 x1873908077709568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098102.929151:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077709568:0@lo:13: 00010000:00010000:1.0:1787098103.185364:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098104.213426:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098105.236084:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787098105.487454:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787098105.487462:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d7227639800 from 30 10000000:01000000:1.0:1787098105.487468:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787098105.487509:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098105.487522:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098105.487533:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098105.487575:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077709696:0@lo:101: 00000100:00100000:1.0:1787098105.487776:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.487841:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787098105.488233:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077709696 00000100:00100000:3.0:1787098105.488243:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077709696 00000100:00100000:3.0:1787098105.488449:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787098105.488460:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077709696:12345-0@lo:101: 00010000:00010000:3.0:1787098105.488476:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098105.488491:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01445c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098105.488516:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01445c1 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098105.488528:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01445c1 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098105.489298:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7200, rc 0) 00000100:00100000:3.0:1787098105.489382:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077709696:12345-0@lo:101: Request processed in 921us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098105.489389:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787098105.490405:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077709696:0@lo:101: 00010000:00010000:1.0:1787098105.490432:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098105.490445:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098105.490624:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077709824:0@lo:501: 00000100:00100000:1.0:1787098105.490684:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.490723:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787098105.491158:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077709824 00000100:00100000:3.0:1787098105.491165:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077709824 00000100:00100000:3.0:1787098105.491268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787098105.491294:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077709824:12345-0@lo:501: 00000100:00100000:3.0:1787098105.491667:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077709824:12345-0@lo:501: Request processed in 388us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098105.491675:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787098105.491749:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077709824:0@lo:501: 00000100:00100000:0.0:1787098105.491894:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077709952:0@lo:503: 00000100:00100000:0.0:1787098105.491936:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.494299:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72068280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098105.495221:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077709952 00000100:00100000:2.0:1787098105.495237:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077709952 00000100:00100000:2.0:1787098105.495381:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787098105.495392:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077709952:12345-0@lo:503: 00000100:00100000:2.0:1787098105.496638:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077709952:12345-0@lo:503: Request processed in 1243us (4696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098105.496648:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787098105.496733:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077709952:0@lo:503: 00000100:00100000:0.0:1787098105.497421:0:8134:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8134:1873908077710080:0@lo:502: 00000100:00100000:0.0:1787098105.497477:0:8134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.497523:0:8134:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828540 going to sleep for 11 seconds 00000100:00100000:2.0:1787098105.497584:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077710080 00000100:00100000:2.0:1787098105.497589:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077710080 00000100:00100000:2.0:1787098105.497631:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787098105.497641:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:8134:x1873908077710080:12345-0@lo:502: 00000100:00100000:2.0:1787098105.497911:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:8134:x1873908077710080:12345-0@lo:502: Request processed in 271us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098105.497919:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787098105.498008:0:8134:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8134:1873908077710080:0@lo:502: 00000100:00100000:0.0:1787098105.498048:0:8134:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8134:1873908077710208:0@lo:502: 00000100:00100000:0.0:1787098105.498079:0:8134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.498099:0:8134:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828540 going to sleep for 11 seconds 00000100:00100000:2.0:1787098105.498216:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077710208 00000100:00100000:2.0:1787098105.498220:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077710208 00000100:00100000:2.0:1787098105.498251:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787098105.498258:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:8134:x1873908077710208:12345-0@lo:502: 00000100:00100000:2.0:1787098105.498406:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:8134:x1873908077710208:12345-0@lo:502: Request processed in 148us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098105.498419:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787098105.498760:0:8134:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8134:1873908077710208:0@lo:502: 00000040:00080000:0.0:1787098105.498780:0:8134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787098105.501210:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787098105.501242:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787098105.501254:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098105.501266:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098105.501276:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787098105.502671:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787098105.502677:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787098105.502718:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098105.502729:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098105.502741:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098105.502765:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077710336:0@lo:101: 00000100:00100000:2.0:1787098105.502834:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098105.502922:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7202cff300 going to sleep for 11 seconds 00000100:00100000:3.0:1787098105.503491:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077710336 00000100:00100000:3.0:1787098105.503500:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077710336 00000100:00100000:0.0:1787098105.506866:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787098105.506892:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077710336:12345-0@lo:101: 00010000:00010000:0.0:1787098105.506923:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098105.506943:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01445cf expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.506972:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01445cf expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.506984:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01445cf expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.506994:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030400, rc 0) 00000100:00100000:0.0:1787098105.507591:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077710336:12345-0@lo:101: Request processed in 709us (4755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.507600:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787098105.507708:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077710336:0@lo:101: 00010000:00010000:1.0:1787098105.507727:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098105.507739:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098105.507810:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077710464:0@lo:501: 00000100:00100000:1.0:1787098105.507847:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.507885:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.507928:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077710464 00000100:00100000:0.0:1787098105.507934:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077710464 00000100:00100000:0.0:1787098105.507973:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787098105.507980:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077710464:12345-0@lo:501: 00000100:00100000:0.0:1787098105.508492:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077710464:12345-0@lo:501: Request processed in 511us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.508500:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787098105.508590:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077710464:0@lo:501: 00000100:00100000:1.0:1787098105.508620:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077710592:0@lo:503: 00000100:00100000:1.0:1787098105.508677:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.508704:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.508793:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077710592 00000100:00100000:0.0:1787098105.508797:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077710592 00000100:00100000:0.0:1787098105.508832:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787098105.508840:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077710592:12345-0@lo:503: 00000100:00100000:0.0:1787098105.509447:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077710592:12345-0@lo:503: Request processed in 606us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.509454:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787098105.509628:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077710592:0@lo:503: 00000100:00100000:0.0:1787098105.511631:0:8136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8136:1873908077710720:0@lo:502: 00000100:00100000:0.0:1787098105.511714:0:8136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.511800:0:8136:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828840 going to sleep for 11 seconds 00000100:00100000:3.0:1787098105.512448:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077710720 00000100:00100000:3.0:1787098105.512456:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077710720 00000100:00100000:3.0:1787098105.512564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787098105.512575:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:8136:x1873908077710720:12345-0@lo:502: 00000100:00100000:3.0:1787098105.513143:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:8136:x1873908077710720:12345-0@lo:502: Request processed in 569us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098105.513153:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787098105.513250:0:8136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8136:1873908077710720:0@lo:502: 00000020:01000000:1.0:1787098105.513349:0:8136:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098105.513360:0:8136:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098105.513363:0:8136:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787098105.513368:0:8136:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787098105.513370:0:8136:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787098105.513394:0:8136:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad40700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8136:1873908077710848:0@lo:502: 00000100:00100000:1.0:1787098105.513444:0:8136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.513506:0:8136:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.513584:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077710848 00000100:00100000:0.0:1787098105.513590:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077710848 00000100:00100000:0.0:1787098105.513667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787098105.513677:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:8136:x1873908077710848:12345-0@lo:502: 00000100:00100000:0.0:1787098105.513841:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:8136:x1873908077710848:12345-0@lo:502: Request processed in 166us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.513850:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787098105.513940:0:8136:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad40700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8136:1873908077710848:0@lo:502: 00000020:01000000:3.0:1787098105.514312:0:8136:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787098105.514320:0:8136:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098105.514322:0:8136:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787098105.514327:0:8136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787098105.515320:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787098105.515345:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787098105.515357:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098105.515368:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098105.515378:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787098105.515381:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d72079cb000 from 30 10000000:01000000:1.0:1787098105.515384:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787098105.515413:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098105.515421:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098105.515432:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098105.515462:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077710976:0@lo:101: 00000100:00100000:1.0:1787098105.515506:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.515545:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787098105.517077:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077710976 00000100:00100000:3.0:1787098105.517092:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077710976 00000100:00100000:3.0:1787098105.517153:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787098105.517164:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077710976:12345-0@lo:101: 00010000:00010000:3.0:1787098105.517180:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098105.517195:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01445dd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098105.517235:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01445dd expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098105.517247:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01445dd expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098105.517257:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6000, rc 0) 00000100:00100000:3.0:1787098105.517350:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077710976:12345-0@lo:101: Request processed in 187us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098105.517358:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787098105.517385:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077710976:0@lo:101: 00010000:00010000:0.0:1787098105.517403:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.517419:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098105.517495:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711104:0@lo:501: 00000100:00100000:0.0:1787098105.517526:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.517561:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72068280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098105.517679:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077711104 00000100:00100000:1.0:1787098105.517684:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077711104 00000100:00100000:1.0:1787098105.517717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787098105.517724:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077711104:12345-0@lo:501: 00000100:00100000:1.0:1787098105.517982:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077711104:12345-0@lo:501: Request processed in 257us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098105.517989:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787098105.518264:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711104:0@lo:501: 00000100:00100000:0.0:1787098105.518309:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711232:0@lo:503: 00000100:00100000:0.0:1787098105.518353:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.518387:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72068280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098105.518390:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077711232 00000100:00100000:1.0:1787098105.518397:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077711232 00000100:00100000:1.0:1787098105.518431:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787098105.518439:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077711232:12345-0@lo:503: 00000100:00100000:1.0:1787098105.518590:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077711232:12345-0@lo:503: Request processed in 152us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098105.518598:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787098105.518694:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711232:0@lo:503: 00000100:00100000:0.0:1787098105.519394:0:8137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8137:1873908077711360:0@lo:502: 00000100:00100000:0.0:1787098105.519445:0:8137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.519485:0:8137:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828840 going to sleep for 11 seconds 00000100:00100000:3.0:1787098105.521705:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077711360 00000100:00100000:3.0:1787098105.521718:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077711360 00000100:00100000:3.0:1787098105.521773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787098105.521785:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:8137:x1873908077711360:12345-0@lo:502: 00000100:00100000:3.0:1787098105.522168:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:8137:x1873908077711360:12345-0@lo:502: Request processed in 385us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098105.522176:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787098105.522272:0:8137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8137:1873908077711360:0@lo:502: 00000100:00100000:0.0:1787098105.522361:0:8137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8137:1873908077711488:0@lo:502: 00000100:00100000:0.0:1787098105.522407:0:8137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.522435:0:8137:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828840 going to sleep for 11 seconds 00000100:00100000:3.0:1787098105.522490:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077711488 00000100:00100000:3.0:1787098105.522494:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077711488 00000100:00100000:3.0:1787098105.522528:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787098105.522535:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:8137:x1873908077711488:12345-0@lo:502: 00000100:00100000:3.0:1787098105.522675:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:8137:x1873908077711488:12345-0@lo:502: Request processed in 140us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098105.522682:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787098105.522754:0:8137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8137:1873908077711488:0@lo:502: 00000040:00080000:0.0:1787098105.522774:0:8137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787098105.522916:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787098105.522934:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787098105.522944:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098105.523034:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098105.523045:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787098105.523048:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d72079cb000 from 5 10000000:01000000:3.0:1787098105.523050:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787098105.523075:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098105.523084:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098105.523094:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098105.523106:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711616:0@lo:101: 00000100:00100000:3.0:1787098105.523136:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098105.523583:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720faab3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.528583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077711616 00000100:00100000:0.0:1787098105.528599:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077711616 00000100:00100000:0.0:1787098105.528679:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787098105.528689:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077711616:12345-0@lo:101: 00010000:00010000:0.0:1787098105.528707:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098105.528727:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200030000/0xb1d871f9b01445f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01445eb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.528755:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200030000/0xb1d871f9b01445f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01445eb expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.528767:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200030000/0xb1d871f9b01445f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01445eb expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.528777:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030000, rc 0) 00000100:00100000:0.0:1787098105.528852:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077711616:12345-0@lo:101: Request processed in 164us (5715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.528860:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787098105.528910:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711616:0@lo:101: 00010000:00010000:0.0:1787098105.528933:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.528944:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098105.529013:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711744:0@lo:256: 00000100:00100000:0.0:1787098105.529051:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.529082:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72068283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.529094:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077711744 00000100:00100000:0.0:1787098105.529098:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077711744 00000100:00100000:0.0:1787098105.529118:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787098105.529125:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077711744:12345-0@lo:256: 20000000:01000000:0.0:1787098105.529137:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787098105.529152:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787098105.529156:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787098105.529228:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077711744:12345-0@lo:256: Request processed in 103us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.529236:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787098105.529268:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711744:0@lo:256: 10000000:01000000:0.0:1787098105.529330:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787098105.529337:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.529346:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098105.529356:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787098105.529363:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787098105.529365:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787098105.529393:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.529402:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.529410:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098105.529421:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711872:0@lo:101: 00000100:00100000:0.0:1787098105.529447:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.529460:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72068283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.529471:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077711872 00000100:00100000:0.0:1787098105.529474:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077711872 00000100:00100000:0.0:1787098105.529492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787098105.529498:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077711872:12345-0@lo:101: 00010000:00010000:0.0:1787098105.529504:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098105.529512:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01445f9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.529525:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01445f9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.529533:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01445f9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.529540:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695c00, rc 0) 00000100:00100000:0.0:1787098105.529566:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077711872:12345-0@lo:101: Request processed in 68us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.529578:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787098105.529607:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077711872:0@lo:101: 00010000:00010000:0.0:1787098105.529617:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.529625:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098105.529678:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077712000:0@lo:501: 00000100:00100000:0.0:1787098105.529702:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.529715:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72068283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.529726:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077712000 00000100:00100000:0.0:1787098105.529729:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077712000 00000100:00100000:0.0:1787098105.529748:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787098105.529753:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077712000:12345-0@lo:501: 00000100:00100000:0.0:1787098105.529981:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077712000:12345-0@lo:501: Request processed in 227us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.529988:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787098105.530017:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077712000:0@lo:501: 00000100:00100000:0.0:1787098105.530041:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077712128:0@lo:503: 00000100:00100000:0.0:1787098105.530075:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.530087:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72068283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.530097:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077712128 00000100:00100000:0.0:1787098105.530101:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077712128 00000100:00100000:0.0:1787098105.530118:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787098105.530123:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077712128:12345-0@lo:503: 00000100:00100000:0.0:1787098105.530426:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077712128:12345-0@lo:503: Request processed in 302us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.530434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787098105.530471:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077712128:0@lo:503: 00000100:00100000:0.0:1787098105.536843:0:8140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8140:1873908077712256:0@lo:502: 00000100:00100000:0.0:1787098105.536928:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.537048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077712256 00000100:00100000:0.0:1787098105.537056:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077712256 00000100:00100000:0.0:1787098105.537103:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787098105.537113:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8140:x1873908077712256:12345-0@lo:502: 00000100:00100000:0.0:1787098105.538166:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8140:x1873908077712256:12345-0@lo:502: Request processed in 1049us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.538176:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787098105.538245:0:8140:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72076b8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.538273:0:8140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8140:1873908077712256:0@lo:502: 00000020:01000000:0.0:1787098105.538336:0:8140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787098105.538344:0:8140:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787098105.538352:0:8140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098105.538354:0:8140:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787098105.538359:0:8140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787098105.538364:0:8140:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:0.0:1787098105.538387:0:8140:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787098105.538389:0:8140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787098105.538403:0:8140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d7241928000) 00000020:00000080:0.0:1787098105.538429:0:8140:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787098105.538434:0:8140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787098105.538517:0:8140:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787098105.538532:0:8140:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787098105.538540:0:8140:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b014460e 00010000:00080000:0.0:1787098105.538569:0:8140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7240289800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1787098105.538837:0:8140:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787098105.540053:0:8140:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787098105.540069:0:8140:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787098105.540644:0:8140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787098105.541094:0:8140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787098105.541151:0:8140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787098105.541212:0:8140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787098105.541723:0:8141:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787098105.541728:0:8141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787098105.544485:0:8140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787098105.544500:0:8140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787098105.544538:0:8140:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787098105.544561:0:8140:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b0144615 00000100:00080000:2.0:1787098105.544571:0:8140:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787098105.544583:0:8140:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d7240289800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1787098105.544617:0:8140:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7207461c00 x1873908077712384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787098105.545211:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077712384:0@lo:8: 00000100:00100000:1.0:1787098105.545305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.545394:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077712384 00000100:00100000:0.0:1787098105.545402:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077712384 00000100:00100000:0.0:1787098105.545456:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787098105.545465:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3308:x1873908077712384:12345-0@lo:8: 00010000:00080000:0.0:1787098105.545494:0:6860:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1787098105.545520:0:6860:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b014461c 00002000:00100000:0.0:1787098105.545534:0:6860:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d7104d92800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787098105.545538:0:6860:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787098105.545542:0:6860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787098105.545680:0:6860:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1787098105.545951:0:8140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787098105.546028:0:8140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098105.546034:0:8140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098105.546036:0:8140:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787098105.546040:0:8140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098105.546044:0:8140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098105.546046:0:8140:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787098105.546049:0:8140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787098105.546051:0:8140:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787098105.546075:0:8140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8140:1873908077712640:0@lo:502: 00000100:00100000:1.0:1787098105.546107:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077712512:0@lo:400: 00000100:00100000:1.0:1787098105.546135:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098105.546136:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098105.546165:0:8140:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206417780 going to sleep for 11 seconds 00002000:00080000:0.0:1787098105.546246:0:6860:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787098105.546307:0:6860:0:(import.c:65:import_set_state_nolock()) ffff8d723b577800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098105.546359:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1873908077712384:12345-0@lo:8: Request processed in 893us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.546369:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098105.546390:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077712896:0@lo:400: 00000100:00100000:0.0:1787098105.546402:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077712640 00000100:00100000:0.0:1787098105.546406:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077712640 00000100:00100000:2.0:1787098105.546416:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.546445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787098105.546452:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8140:x1873908077712640:12345-0@lo:502: 00000100:00100000:2.0:1787098105.546517:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787098105.546523:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077712768:0@lo:400: 00000100:00100000:0.0:1787098105.546681:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8140:x1873908077712640:12345-0@lo:502: Request processed in 229us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.546688:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1787098105.546747:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207461c00 x1873908077712384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787098115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098105.546845:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787098105.546855:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787098105.546863:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787098105.546868:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787098105.546870:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7240289800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787098105.546882:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787098105.546888:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077712384:0@lo:8: 00000100:00100000:2.0:1787098105.546899:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.546918:0:8140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8140:1873908077712640:0@lo:502: 00000100:00100000:2.0:1787098105.546930:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077713024:0@lo:400: 00000020:01000000:0.0:1787098105.546939:0:8140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098105.546944:0:8140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098105.546946:0:8140:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787098105.546950:0:8140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787098105.546955:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098105.546982:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077712512 00000100:00100000:2.0:1787098105.546986:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077712512 00000100:00100000:2.0:1787098105.547016:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077712768 00000100:00100000:2.0:1787098105.547019:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077712768 00000100:00100000:2.0:1787098105.547040:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077713024 00000100:00100000:2.0:1787098105.547042:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077713024 00000100:00100000:2.0:1787098105.547055:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787098105.547067:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077712512:12345-0@lo:400: 00000020:01000000:0.0:1787098105.547086:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:2.0:1787098105.547099:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077712512:12345-0@lo:400: Request processed in 34us (964us total) trans 0 rc 0/0 10000000:01000000:0.0:1787098105.547102:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:2.0:1787098105.547105:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787098105.547110:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098105.547116:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787098105.547120:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098105.547122:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077712768:12345-0@lo:400: 10000000:01000000:0.0:1787098105.547130:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787098105.547138:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d7208e14d40 from 1 10000000:01000000:0.0:1787098105.547141:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:2.0:1787098105.547150:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077712768:12345-0@lo:400: Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098105.547155:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787098105.547165:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787098105.547171:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077713024:12345-0@lo:400: 00010000:00010000:0.0:1787098105.547171:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.547179:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.547188:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098105.547202:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077713152:0@lo:101: 00000100:00100000:0.0:1787098105.547233:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.547250:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.547264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077713152 00000100:00100000:0.0:1787098105.547267:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077713152 00000100:00100000:0.0:1787098105.547312:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787098105.547319:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077713152:12345-0@lo:101: 00010000:00010000:0.0:1787098105.547327:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098105.547341:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144623 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.547360:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144623 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.547371:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144623 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.547379:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694600, rc 0) 00000100:00100000:0.0:1787098105.547407:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077713152:12345-0@lo:101: Request processed in 89us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.547419:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787098105.547451:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077713152:0@lo:101: 00010000:00010000:0.0:1787098105.547463:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.547471:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098105.547511:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077713280:0@lo:501: 00000100:00100000:0.0:1787098105.547534:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.547548:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098105.547559:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077713280 00000100:00100000:0.0:1787098105.547562:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077713280 00000100:00100000:0.0:1787098105.547583:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787098105.547588:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077713280:12345-0@lo:501: 00000100:00100000:3.0:1787098105.547870:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077712896 00000100:00100000:3.0:1787098105.547875:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077712896 00000100:00100000:3.0:1787098105.547906:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098105.547910:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077713024:12345-0@lo:400: Request processed in 740us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098105.547913:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077712896:12345-0@lo:400: 00000100:00100000:2.0:1787098105.547917:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787098105.547940:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787098105.547944:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098105.547948:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077712896:12345-0@lo:400: Request processed in 36us (1531us total) trans 0 rc 0/0 00010000:00080000:2.0:1787098105.547962:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ad42a00 x1873908077713024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098105.547967:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098105.547973:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077713024:0@lo:400: 00010000:00080000:2.0:1787098105.547999:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ad40700 x1873908077712768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098105.548007:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077712768:0@lo:400: 00010000:00080000:2.0:1787098105.548016:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ad43100 x1873908077712896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098105.548023:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077712896:0@lo:400: 00000100:00100000:0.0:1787098105.550209:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077713280:12345-0@lo:501: Request processed in 2609us (2662us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787098105.550224:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787098105.550314:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077713280:0@lo:501: 10000000:01000000:0.0:1787098105.550356:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787098105.550368:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098105.550380:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787098105.550411:0:8141:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787098105.550582:0:8141:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 203806301256ns, next at 0ns, rc = 0 00010000:00080000:1.0:1787098105.550790:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ad42680 x1873908077712512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098105.550804:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077712512:0@lo:400: 00000004:00080000:1.0:1787098105.616851:0:8142:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787098105.616890:0:8142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8142:1873908077713536:0@lo:7: 00000100:00100000:1.0:1787098105.616958:0:8142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.617004:0:8142:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787098105.617039:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077713408:0@lo:13: 00000100:00100000:1.0:1787098105.617064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.617102:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077713536 00000100:00100000:1.0:1787098105.617109:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077713536 00000100:00100000:1.0:1787098105.617161:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787098105.617170:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8142:x1873908077713536:12345-0@lo:7: 00000100:00080000:3.0:1787098105.623357:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787098105.623387:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077713408 00000100:00100000:3.0:1787098105.623398:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077713408 00000100:00100000:3.0:1787098105.623463:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787098105.623473:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1873908077713408:12345-0@lo:13: 00002000:00000024:3.0:1787098105.623502:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787098105.624046:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1873908077713408:12345-0@lo:13: Request processed in 572us (6977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098105.624055:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787098105.625916:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ad42680 x1873908077713408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098105.625944:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077713408:0@lo:13: 00002000:00080000:1.0:1787098105.628525:0:6703:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787098105.628532:0:6703:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787098105.628620:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8142:x1873908077713536:12345-0@lo:7: Request processed in 11447us (11658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098105.628631:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787098105.629142:0:8142:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ad40380 x1873908077713536/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787098121 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098105.629158:0:8142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8142:1873908077713536:0@lo:7: 00000004:00080000:1.0:1787098105.629173:0:8142:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787098105.629216:0:8142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8142:1873908077713664:0@lo:5: 00000100:00100000:1.0:1787098105.629254:0:8142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.630742:0:8142:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787098105.630771:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077713664 00000100:00100000:1.0:1787098105.630781:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077713664 00000100:00100000:1.0:1787098105.630842:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787098105.630850:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8142:x1873908077713664:12345-0@lo:5: 00002000:00080000:1.0:1787098105.630880:0:6702:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787098105.630884:0:6702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787098105.631212:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8142:x1873908077713664:12345-0@lo:5: Request processed in 361us (1956us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787098105.631220:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787098105.631339:0:8142:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ad40380 x1873908077713664/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787098121 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098105.631356:0:8142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad40380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8142:1873908077713664:0@lo:5: 00000004:00080000:1.0:1787098105.631367:0:8142:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787098105.631405:0:8142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8142:1873908077713792:0@lo:700: 00000100:00100000:1.0:1787098105.631441:0:8142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.631467:0:8142:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787098105.631479:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077713792 00000100:00100000:1.0:1787098105.631483:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077713792 00000100:00100000:1.0:1787098105.631510:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787098105.631516:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8142:x1873908077713792:12345-0@lo:700: 00000100:00100000:1.0:1787098105.631541:0:6709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6709:1873908077713920:0@lo:700: 00000100:00100000:1.0:1787098105.631566:0:6709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098105.631582:0:6709:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098105.631601:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077713920 00000100:00100000:1.0:1787098105.631604:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077713920 00000100:00100000:1.0:1787098105.631628:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787098105.631634:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6709:x1873908077713920:12345-0@lo:700: 00000004:00080000:1.0:1787098105.652114:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787098105.719585:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787098105.734623:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6709:x1873908077713920:12345-0@lo:700: Request processed in 102981us (103047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.734638:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787098105.734912:0:6709:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ad43100 x1873908077713920/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787098121 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098105.734930:0:6709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6709:1873908077713920:0@lo:700: 40000000:02000000:1.0:1787098105.734944:0:6709:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1787098105.804560:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8142:x1873908077713792:12345-0@lo:700: Request processed in 173034us (173110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098105.804580:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:0.0:1787098105.804624:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787098105.804636:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:0.0:1787098105.804702:0:8142:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ad41180 x1873908077713792/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787098121 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098105.804720:0:8142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8142:1873908077713792:0@lo:700: 00000004:02000040:0.0:1787098105.862476:0:8142:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787098105.870421:0:8142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8142:1873908077714048:0@lo:5: 00000100:00100000:0.0:1787098105.870497:0:8142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098105.870571:0:8142:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098105.870617:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077714048 00000100:00100000:1.0:1787098105.870627:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077714048 00000100:00100000:1.0:1787098105.870701:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787098105.870712:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8142:x1873908077714048:12345-0@lo:5: 00002000:00080000:1.0:1787098105.877377:0:6860:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787098105.877401:0:6860:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787098105.881330:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8142:x1873908077714048:12345-0@lo:5: Request processed in 10612us (10825us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787098105.881344:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787098105.881669:0:8142:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227527480 x1873908077714048/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787098121 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098105.881685:0:8142:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787098105.881701:0:8142:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d7227527480 x1873908077714048/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787098121 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098105.881713:0:8142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8142:1873908077714048:0@lo:5: 00000004:00080000:0.0:1787098105.881729:0:8142:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787098106.257101:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787098106.600730:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1787098107.023260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098107.023324:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059865216 00000100:00100000:1.0:1787098107.023334:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059865216 00000100:00100000:1.0:1787098107.023377:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:1.0:1787098107.023386:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2372:x1873908059865216:12345-192.168.204.51@tcp:250: 00010000:00080000:1.0:1787098107.023415:0:5838:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 4f7b54d1-1395-452b-8e33-1bd24f400ba4@192.168.204.51@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1787098107.023447:0:5838:0:(genops.c:1406:class_connect()) connect: client 4f7b54d1-1395-452b-8e33-1bd24f400ba4, cookie 0xb1d871f9b0144631 00000100:00080000:1.0:1787098107.023589:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8d7241aae000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098107.023665:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+5:2372:x1873908059865216:12345-192.168.204.51@tcp:250: Request processed in 278us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098107.023689:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:1.0:1787098107.028233:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098107.032464:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059865344 00000100:00100000:3.0:1787098107.032479:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059865344 00000100:00100000:3.0:1787098107.032536:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:3.0:1787098107.032547:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+5:5598:x1873908059865344:12345-192.168.204.51@tcp:101: 00010000:00010000:3.0:1787098107.032565:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098107.032584:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e528733e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.032613:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528733e expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.032636:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528733e expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.033042:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6400, rc 0) 00000100:00100000:3.0:1787098107.033118:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+6:5598:x1873908059865344:12345-192.168.204.51@tcp:101: Request processed in 572us (4894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098107.033126:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:0.0:1787098107.036500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098107.036572:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059865472 00000100:00100000:2.0:1787098107.036581:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059865472 00000100:00100000:2.0:1787098107.036643:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:2.0:1787098107.036653:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+6:5598:x1873908059865472:12345-192.168.204.51@tcp:501: 00000100:00100000:2.0:1787098107.036996:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+6:5598:x1873908059865472:12345-192.168.204.51@tcp:501: Request processed in 342us (504us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787098107.037005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:1.0:1787098107.039931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098107.040043:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059865600 00000100:00100000:3.0:1787098107.040054:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059865600 00000100:00100000:3.0:1787098107.040108:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:3.0:1787098107.040117:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+6:5598:x1873908059865600:12345-192.168.204.51@tcp:101: 00010000:00010000:3.0:1787098107.040148:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098107.040165:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287345 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.040197:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287345 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.040209:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287345 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.040217:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6600, rc 0) 00000100:00100000:3.0:1787098107.040276:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+7:5598:x1873908059865600:12345-192.168.204.51@tcp:101: Request processed in 159us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098107.040302:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:1.0:1787098107.045578:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098107.046072:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059865728 00000100:00100000:2.0:1787098107.046083:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059865728 00000100:00100000:2.0:1787098107.046169:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:2.0:1787098107.046180:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+7:5598:x1873908059865728:12345-192.168.204.51@tcp:501: 00000100:00100000:2.0:1787098107.046492:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:5598:x1873908059865728:12345-192.168.204.51@tcp:501: Request processed in 312us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098107.046500:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:1.0:1787098107.050910:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098107.051024:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059865856 00000100:00100000:0.0:1787098107.051034:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059865856 00000100:00100000:0.0:1787098107.051099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:0.0:1787098107.051108:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:5598:x1873908059865856:12345-192.168.204.51@tcp:503: 00000100:00100000:0.0:1787098107.051484:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:5598:x1873908059865856:12345-192.168.204.51@tcp:503: Request processed in 376us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098107.051492:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:0.0:1787098107.056484:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098107.056794:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059865984 00000100:00100000:2.0:1787098107.056804:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059865984 00000100:00100000:2.0:1787098107.056859:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1787098107.056870:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:5616:x1873908059865984:12345-192.168.204.51@tcp:502: 00000100:00100000:2.0:1787098107.057247:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:5616:x1873908059865984:12345-192.168.204.51@tcp:502: Request processed in 376us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098107.057256:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:1.0:1787098107.074327:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098107.075515:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059866112 00000100:00100000:3.0:1787098107.075528:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059866112 00000100:00100000:2.0:1787098107.077516:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:2.0:1787098107.077528:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:5616:x1873908059866112:12345-192.168.204.51@tcp:502: 00000100:00100000:2.0:1787098107.077841:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:5616:x1873908059866112:12345-192.168.204.51@tcp:502: Request processed in 314us (3564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098107.077861:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:1.0:1787098107.080947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098107.081042:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059866240 00000100:00100000:3.0:1787098107.081052:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059866240 00000100:00100000:3.0:1787098107.081149:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:3.0:1787098107.081160:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:5598:x1873908059866240:12345-192.168.204.51@tcp:101: 00010000:00010000:3.0:1787098107.081175:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098107.081193:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6c00/0xb1d871f9b0144646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e528736f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.081219:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6c00/0xb1d871f9b0144646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528736f expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.081231:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6c00/0xb1d871f9b0144646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528736f expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.081258:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6c00, rc 0) 00000100:00100000:3.0:1787098107.081352:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5598:x1873908059866240:12345-192.168.204.51@tcp:101: Request processed in 188us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098107.081360:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:1.0:1787098107.088065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098107.088172:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059866368 00000100:00100000:0.0:1787098107.088182:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059866368 00000100:00100000:0.0:1787098107.088241:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:0.0:1787098107.088252:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5598:x1873908059866368:12345-192.168.204.51@tcp:256: 20000000:01000000:0.0:1787098107.088314:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787098107.088337:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787098107.088341:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787098107.088357:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787098107.088360:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787098107.090811:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5598:x1873908059866368:12345-192.168.204.51@tcp:256: Request processed in 2550us (2744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098107.090825:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:1.0:1787098107.094558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098107.094811:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059866496 00000100:00100000:3.0:1787098107.094823:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059866496 00000100:00100000:3.0:1787098107.094875:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:3.0:1787098107.094884:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5598:x1873908059866496:12345-192.168.204.51@tcp:101: 00010000:00010000:3.0:1787098107.094899:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098107.094916:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.094942:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287376 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.094953:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287376 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098107.094964:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6e00, rc 0) 00000100:00100000:3.0:1787098107.095024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5598:x1873908059866496:12345-192.168.204.51@tcp:101: Request processed in 141us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098107.095031:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:2.0:1787098107.097036:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098107.097123:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059866624 00000100:00100000:1.0:1787098107.097136:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059866624 00000100:00100000:1.0:1787098107.097228:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1787098107.097238:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5598:x1873908059866624:12345-192.168.204.51@tcp:501: 00000100:00100000:1.0:1787098107.097537:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5598:x1873908059866624:12345-192.168.204.51@tcp:501: Request processed in 300us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098107.097546:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1787098107.102500:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098107.105236:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059866752 00000100:00100000:1.0:1787098107.105252:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059866752 00000100:00100000:1.0:1787098107.105318:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:1.0:1787098107.105328:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5598:x1873908059866752:12345-192.168.204.51@tcp:503: 00000100:00100000:1.0:1787098107.108988:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5598:x1873908059866752:12345-192.168.204.51@tcp:503: Request processed in 3648us (6486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098107.109003:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:1.0:1787098107.112017:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098107.112257:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059866880 00000100:00100000:2.0:1787098107.112267:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059866880 00000100:00100000:2.0:1787098107.112337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:2.0:1787098107.112353:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5620:x1873908059866880:12345-192.168.204.51@tcp:502: 00000100:00100000:2.0:1787098107.112588:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5620:x1873908059866880:12345-192.168.204.51@tcp:502: Request processed in 242us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098107.112596:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:2.0:1787098107.114488:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098107.114574:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059867008 00000100:00100000:1.0:1787098107.114583:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059867008 00000100:00100000:1.0:1787098107.114659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:1.0:1787098107.114669:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5620:x1873908059867008:12345-192.168.204.51@tcp:502: 00000100:00100000:1.0:1787098107.114893:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5620:x1873908059867008:12345-192.168.204.51@tcp:502: Request processed in 225us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098107.114901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:0.0:1787098107.121404:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098107.121442:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059867136 00000100:00100000:0.0:1787098107.121452:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059867136 00000100:00100000:0.0:1787098107.121494:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1787098107.121502:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2372:x1873908059867136:12345-192.168.204.51@tcp:38: 00010000:00080000:0.0:1787098107.121533:0:6853:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1787098107.121582:0:6853:0:(genops.c:1406:class_connect()) connect: client 530d6019-f48b-45e0-97e8-95fbd128e52b, cookie 0xb1d871f9b0144654 00000004:00100000:0.0:1787098107.121611:0:6853:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787098107.121637:0:6853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787098107.150010:0:6853:0:(import.c:65:import_set_state_nolock()) ffff8d723b573000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098107.150101:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2372:x1873908059867136:12345-192.168.204.51@tcp:38: Request processed in 28598us (28708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098107.150113:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00010000:00010000:1.0:1787098107.281295:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098108.047552:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077714176:0@lo:13: 00000100:00100000:2.0:1787098108.047628:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098108.047745:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077714176 00000100:00100000:0.0:1787098108.047753:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077714176 00000100:00100000:0.0:1787098108.047823:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787098108.047833:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077714176:12345-0@lo:13: 00002000:00000024:0.0:1787098108.047867:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098108.047922:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077714176:12345-0@lo:13: Request processed in 90us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098108.047929:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787098108.048051:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787098108.048081:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227524700 x1873908077714176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098108.048099:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077714176:0@lo:13: 00000100:00100000:3.0:1787098108.152983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098108.153030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098108.153124:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059867392 00000100:00100000:2.0:1787098108.153134:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059867392 00000100:00100000:2.0:1787098108.153209:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059867264 00000100:00100000:2.0:1787098108.153213:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059867264 00000100:00100000:2.0:1787098108.153239:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1787098108.153249:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:5598:x1873908059867392:12345-192.168.204.51@tcp:41: 00000004:00000024:2.0:1787098108.153315:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787098108.153439:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:5598:x1873908059867392:12345-192.168.204.51@tcp:41: Request processed in 191us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098108.153465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1787098108.153483:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1787098108.153490:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:0:x1873908059867264:12345-192.168.204.51@tcp:41: 00000004:00000024:2.0:1787098108.153501:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787098108.153524:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:0:x1873908059867264:12345-192.168.204.51@tcp:41: Request processed in 35us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098108.153530:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00080000:3.0:1787098108.154134:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098108.155478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098108.155573:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059867520 00000100:00100000:0.0:1787098108.155583:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059867520 00000100:00100000:0.0:1787098108.155706:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098108.155726:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:5598:x1873908059867520:12345-192.168.204.51@tcp:40: 00000100:00100000:0.0:1787098108.155949:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:5598:x1873908059867520:12345-192.168.204.51@tcp:40: Request processed in 224us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098108.155959:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098108.163857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098108.163907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098108.164012:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059867904 00000100:00100000:2.0:1787098108.164022:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059867904 00000100:00100000:2.0:1787098108.164075:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1787098108.164085:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:5598:x1873908059867904:12345-192.168.204.51@tcp:33: 00000100:00100000:3.0:1787098108.164142:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098108.164187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098108.164411:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059868032 00000100:00100000:1.0:1787098108.164416:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059868032 00000100:00100000:1.0:1787098108.164460:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:1.0:1787098108.164470:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2373:x1873908059868032:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1787098108.164537:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2373:x1873908059868032:12345-192.168.204.51@tcp:400: Request processed in 69us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098108.164545:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:1.0:1787098108.164586:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059867648 00000100:00100000:1.0:1787098108.164590:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059867648 00000100:00100000:1.0:1787098108.164630:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059867776 00000100:00100000:1.0:1787098108.164633:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059867776 00000100:00100000:1.0:1787098108.164652:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1787098108.164657:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1873908059867648:12345-192.168.204.51@tcp:8: 00010000:00080000:1.0:1787098108.164681:0:6701:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:1.0:1787098108.164711:0:6701:0:(genops.c:1406:class_connect()) connect: client 530d6019-f48b-45e0-97e8-95fbd128e52b, cookie 0xb1d871f9b014465b 00002000:00100000:1.0:1787098108.164724:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 530d6019-f48b-45e0-97e8-95fbd128e52b/ffff8d7241aaf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787098108.164737:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787098108.165067:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787098108.165096:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8d7241aaa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098108.165129:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2372:x1873908059867648:12345-192.168.204.51@tcp:8: Request processed in 470us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098108.165143:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1787098108.165162:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1787098108.165175:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1873908059867776:12345-192.168.204.51@tcp:8: 00010000:00080000:1.0:1787098108.165191:0:6701:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:1.0:1787098108.165210:0:6701:0:(genops.c:1406:class_connect()) connect: client 530d6019-f48b-45e0-97e8-95fbd128e52b, cookie 0xb1d871f9b0144662 00002000:00100000:1.0:1787098108.165216:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 530d6019-f48b-45e0-97e8-95fbd128e52b/ffff8d7241aad800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787098108.165231:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787098108.165467:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787098108.165483:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8d7241aa8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098108.165505:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2372:x1873908059867776:12345-192.168.204.51@tcp:8: Request processed in 338us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098108.165512:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000004:00080000:0.0:1787098108.195497:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31338us 00000004:00200000:2.0:1787098108.226049:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787098108.226227:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:5598:x1873908059867904:12345-192.168.204.51@tcp:33: Request processed in 62137us (62313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098108.226240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00010000:00010000:1.0:1787098108.303470:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098108.487853:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098108.491197:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059868160 00000100:00100000:0.0:1787098108.491212:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059868160 00000100:00100000:0.0:1787098108.491384:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1787098108.491397:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:5638:x1873908059868160:12345-192.168.204.51@tcp:101: 00010000:00010000:0.0:1787098108.491435:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098108.491525:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694a00/0xb1d871f9b0144669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52873a0 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098108.491606:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b0144670 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098108.491621:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b0144670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098108.491636:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b0144670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098108.491856:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787098108.491861:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098108.491933:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b0144670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098108.491962:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694a00/0xb1d871f9b0144669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873a0 expref: 8 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098108.491980:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b0144670 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873a0 expref: 7 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098108.491989:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:0.0:1787098108.491992:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787098108.491995:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695400, rc 0) 00000100:00100000:0.0:1787098108.492078:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:5638:x1873908059868160:12345-192.168.204.51@tcp:101: Request processed in 683us (4235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098108.492085:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00010000:00010000:1.0:1787098109.330338:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098110.352220:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098110.607653:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077714304:0@lo:400: 00000100:00100000:1.0:1787098110.607727:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077714432:0@lo:400: 00000100:00100000:3.0:1787098110.607735:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098110.607777:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098110.607791:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077714816:0@lo:400: 00000100:00100000:0.0:1787098110.607805:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077714432 00000100:00100000:1.0:1787098110.607809:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077714944:0@lo:400: 00000100:00100000:0.0:1787098110.607814:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077714432 00000100:00100000:3.0:1787098110.607818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098110.607840:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787098110.607849:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077714688:0@lo:400: 00000100:00100000:1.0:1787098110.607849:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098110.607868:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077714816 00000100:00100000:0.0:1787098110.607871:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077714816 00000100:00100000:3.0:1787098110.607879:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098110.607882:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787098110.607892:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077714560:0@lo:400: 00000100:00100000:0.0:1787098110.607905:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787098110.607915:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077714432:12345-0@lo:400: 00000100:00100000:1.0:1787098110.607922:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098110.607954:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077714944 00000100:00100000:1.0:1787098110.607958:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077714944 00000100:00100000:0.0:1787098110.607974:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077714432:12345-0@lo:400: Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098110.607983:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787098110.607993:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077714688 00000100:00100000:3.0:1787098110.608001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077714304 00000100:00100000:0.0:1787098110.608001:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077714560 00000100:00100000:3.0:1787098110.608004:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077714304 00000100:00100000:0.0:1787098110.608005:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077714560 00000100:00100000:1.0:1787098110.608010:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077714688 00000100:00100000:0.0:1787098110.608027:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787098110.608035:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787098110.608036:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077714816:12345-0@lo:400: 00000100:00100000:3.0:1787098110.608042:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077714304:12345-0@lo:400: 00000100:00100000:1.0:1787098110.608047:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787098110.608072:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077714816:12345-0@lo:400: Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098110.608079:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787098110.608093:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787098110.608100:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077714560:12345-0@lo:400: 00000100:00100000:0.0:1787098110.608126:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077714560:12345-0@lo:400: Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098110.608137:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077714944:12345-0@lo:400: 00000100:00100000:0.0:1787098110.608137:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787098110.608157:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787098110.608162:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787098110.608165:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098110.608179:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077714944:12345-0@lo:400: Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098110.608186:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787098110.608200:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787098110.608205:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077714688:12345-0@lo:400: 00000100:00100000:2.0:1787098110.608788:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077714560:0@lo:400: 00000100:00100000:2.0:1787098110.608802:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077714432:0@lo:400: 00010000:00080000:2.0:1787098110.608818:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207461c00 x1873908077714944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098110.608828:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787098110.608840:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077714944:0@lo:400: 00000100:00100000:3.0:1787098110.611819:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077714304:12345-0@lo:400: Request processed in 3763us (4074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098110.611835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787098110.616065:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077714816:0@lo:400: 00000100:00100000:0.0:1787098110.616092:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077714304:0@lo:400: 00000100:00100000:1.0:1787098110.621084:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077714688:12345-0@lo:400: Request processed in 12867us (13191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098110.621100:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787098110.621263:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207460700 x1873908077714688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098110.621333:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077714688:0@lo:400: 00000100:00100000:3.0:1787098110.718244:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098110.718508:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059868288 00000100:00100000:0.0:1787098110.718519:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059868288 00000100:00100000:0.0:1787098110.718624:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1787098110.718635:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:5690:x1873908059868288:12345-192.168.204.51@tcp:41: 00000004:00000024:0.0:1787098110.718679:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787098110.718757:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:5690:x1873908059868288:12345-192.168.204.51@tcp:41: Request processed in 124us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098110.718765:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00080000:3.0:1787098110.719157:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098110.728097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098110.728224:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059868416 00000100:00100000:0.0:1787098110.728234:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059868416 00000100:00100000:0.0:1787098110.728450:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098110.728460:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:530d6019-f48b-45e0-97e8-95fbd128e52b+6:5690:x1873908059868416:12345-192.168.204.51@tcp:13: 00002000:00000024:0.0:1787098110.728512:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098110.728711:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:530d6019-f48b-45e0-97e8-95fbd128e52b+6:5690:x1873908059868416:12345-192.168.204.51@tcp:13: Request processed in 252us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098110.728720:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00080000:3.0:1787098110.729086:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098110.731092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098110.731200:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059868544 00000100:00100000:0.0:1787098110.731208:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059868544 00000100:00100000:0.0:1787098110.731347:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1787098110.731358:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:530d6019-f48b-45e0-97e8-95fbd128e52b+6:5690:x1873908059868544:12345-192.168.204.51@tcp:13: 00002000:00000024:0.0:1787098110.731397:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098110.731487:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:530d6019-f48b-45e0-97e8-95fbd128e52b+6:5690:x1873908059868544:12345-192.168.204.51@tcp:13: Request processed in 127us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098110.731495:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00080000:3.0:1787098110.735585:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787098111.124037:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787098111.124060:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077715072:0@lo:13: 00000100:00100000:0.0:1787098111.124127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098111.124196:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077715072 00000100:00100000:0.0:1787098111.124202:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077715072 00000100:00100000:0.0:1787098111.124246:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787098111.124254:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077715072:12345-0@lo:13: 00002000:00000024:0.0:1787098111.124274:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098111.124333:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077715072:12345-0@lo:13: Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098111.124340:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787098111.124375:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525180 x1873908077715072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098111.124411:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077715072:0@lo:13: 00010000:00010000:1.0:1787098111.375780:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787098111.727477:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000001:00100000:2.0:1787098112.243116:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00010000:00010000:1.0:1787098112.399951:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787098112.691903:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000100:00100000:0.0:1787098113.169090:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787098113.169116:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077715200:0@lo:13: 00000100:00100000:0.0:1787098113.169189:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098113.169269:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077715200 00000100:00100000:0.0:1787098113.169306:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077715200 00000100:00100000:0.0:1787098113.169367:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787098113.169377:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077715200:12345-0@lo:13: 00002000:00000024:0.0:1787098113.169413:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098113.169459:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077715200:12345-0@lo:13: Request processed in 84us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098113.169467:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787098113.169489:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787098113.169546:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525180 x1873908077715200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098113.169565:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077715200:0@lo:13: 00000001:02000400:3.0:1787098113.280391:0:8310:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787098113.423990:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098113.571566:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098113.571612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098113.571647:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098113.571689:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098113.571718:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059868928 00000100:00100000:2.0:1787098113.571727:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059868928 00000100:00100000:0.0:1787098113.571761:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059869056 00000100:00100000:0.0:1787098113.571765:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059869056 00000100:00100000:0.0:1787098113.571796:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098113.571808:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059868928:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1787098113.571837:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059868800 00000100:00100000:3.0:1787098113.571842:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059868800 00000100:00100000:3.0:1787098113.571890:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1787098113.571899:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059868800:12345-192.168.204.51@tcp:400: 00000100:00100000:0.0:1787098113.571903:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059868928:12345-192.168.204.51@tcp:400: Request processed in 98us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098113.571962:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059868672 00000100:00100000:1.0:1787098113.571967:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059868672 00000100:00100000:1.0:1787098113.571998:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:1.0:1787098113.572006:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2373:x1873908059868672:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1787098113.572234:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059868800:12345-192.168.204.51@tcp:400: Request processed in 336us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098113.572257:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1787098113.574450:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1787098113.574475:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059869056:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1787098113.576373:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2373:x1873908059868672:12345-192.168.204.51@tcp:400: Request processed in 4352us (4804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098113.576390:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:2.0:1787098113.578909:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059869056:12345-192.168.204.51@tcp:400: Request processed in 4433us (7204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098113.578929:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00080000:2.0:1787098113.578996:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787098113.579003:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787098113.579006:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098113.583053:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00010000:00010000:1.0:1787098114.451810:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098115.471662:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098115.728350:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077715328:0@lo:400: 00000100:00100000:3.0:1787098115.728429:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098115.728492:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077715840:0@lo:400: 00000100:00100000:3.0:1787098115.728520:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098115.728546:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787098115.728552:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077715712:0@lo:400: 00000100:00100000:2.0:1787098115.728692:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077715840 00000100:00100000:2.0:1787098115.728700:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077715840 00000100:00100000:2.0:1787098115.728762:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787098115.728772:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077715840:12345-0@lo:400: 00000100:00100000:2.0:1787098115.730215:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077715840:12345-0@lo:400: Request processed in 1435us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098115.730228:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787098115.730264:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098115.730368:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077715328 00000100:00100000:1.0:1787098115.730376:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077715328 00000100:00100000:2.0:1787098115.730393:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077715584:0@lo:400: 00000100:00100000:1.0:1787098115.730418:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787098115.730430:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077715328:12345-0@lo:400: 00000100:00100000:2.0:1787098115.730447:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098115.730506:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077715328:12345-0@lo:400: Request processed in 78us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098115.730513:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787098115.730622:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787098115.730781:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077715456:0@lo:400: 00000100:00100000:2.0:1787098115.730810:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098115.730847:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077715968:0@lo:400: 00000100:00100000:2.0:1787098115.730887:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098115.730929:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077715968 00000100:00100000:2.0:1787098115.730934:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077715968 00000100:00100000:2.0:1787098115.731031:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787098115.731039:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077715968:12345-0@lo:400: 00000100:00100000:2.0:1787098115.731079:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077715968:12345-0@lo:400: Request processed in 42us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098115.731086:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787098115.731105:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787098115.731133:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f91880 x1873908077715968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098115.731148:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077715968:0@lo:400: 00000100:00100000:3.0:1787098115.731251:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098115.731306:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077715328:0@lo:400: 00000100:00100000:3.0:1787098115.731318:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077715840:0@lo:400: 00000100:00100000:1.0:1787098115.731429:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077715584 00000100:00100000:1.0:1787098115.731435:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077715584 00000100:00100000:1.0:1787098115.731479:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077715456 00000100:00100000:1.0:1787098115.731483:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077715456 00000100:00100000:1.0:1787098115.731507:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787098115.731516:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077715584:12345-0@lo:400: 00000100:00100000:2.0:1787098115.731522:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077715712 00000100:00100000:2.0:1787098115.731527:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077715712 00000100:00100000:2.0:1787098115.731559:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787098115.731568:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077715712:12345-0@lo:400: 00000100:00100000:1.0:1787098115.731578:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077715584:12345-0@lo:400: Request processed in 62us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098115.731586:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787098115.731605:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787098115.731612:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077715712:12345-0@lo:400: Request processed in 44us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098115.731621:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787098115.731623:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077715456:12345-0@lo:400: 00000100:00100000:1.0:1787098115.731657:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077715456:12345-0@lo:400: Request processed in 46us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098115.731663:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787098115.732045:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f93480 x1873908077715712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098115.732056:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077715712:0@lo:400: 00000100:00080000:3.0:1787098115.732096:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787098115.732100:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098115.732131:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077715456:0@lo:400: 00000100:00100000:3.0:1787098115.732141:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077715584:0@lo:400: 00000100:00100000:3.0:1787098116.239523:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077716096:0@lo:13: 00000100:00100000:3.0:1787098116.239652:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098116.239832:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077716096 00000100:00100000:0.0:1787098116.239840:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077716096 00000100:00100000:0.0:1787098116.239909:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787098116.239919:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077716096:12345-0@lo:13: 00002000:00000024:0.0:1787098116.239960:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098116.240020:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077716096:12345-0@lo:13: Request processed in 103us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098116.240027:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787098116.240646:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525180 x1873908077716096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098116.240669:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077716096:0@lo:13: 00010000:00010000:3.0:1787098116.496908:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787098116.720154:0:8457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6cf9e8e0 20000000:00000080:0.0:1787098116.720173:0:8457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d723b1a2800 uarg=0000000000000000 20000000:01000000:0.0:1787098116.720208:0:8457:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787098116.720211:0:8457:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787098116.720214:0:8457:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787098116.720219:0:8457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787098116.720223:0:8457:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787098116.720237:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787098116.720240:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787098116.722979:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787098116.722995:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787098116.724143:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787098116.727541:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787098116.727602:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787098116.727637:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787098116.727651:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787098116.727653:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787098116.733208:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787098116.733930:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787098116.734003:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787098116.734043:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787098116.734057:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787098116.734060:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787098116.735023:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787098116.735425:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787098116.735487:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787098116.735534:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787098116.735549:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787098116.735551:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787098116.736186:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787098116.737031:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787098116.737092:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787098116.737126:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1787098116.737141:0:8457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787098116.737159:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737177:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014456d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737185:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144597 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737193:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01445c1 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737200:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01445cf expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737207:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01445dd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737213:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01445f9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737220:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144623 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737237:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528733e expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737245:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287345 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737252:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737337:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287345 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737356:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287345 expref: 9 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.737372:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716224:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098116.737493:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528733e expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737503:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528733e expref: 9 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.737511:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716352:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098116.737541:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144623 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737548:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144623 expref: 18 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.737568:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716480:0@lo:104: 00000100:00100000:3.0:1787098116.737610:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787098116.737651:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01445f9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737659:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01445f9 expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.737667:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a83100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716608:0@lo:104: 00000100:00100000:3.0:1787098116.737686:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098116.737722:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787098116.737732:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077716480 00000100:00100000:3.0:1787098116.737738:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077716480 00000100:00100000:3.0:1787098116.737769:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077716608 00000100:00100000:3.0:1787098116.737771:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077716608 00000100:00100000:3.0:1787098116.737785:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787098116.737793:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:8457:x1873908077716480:12345-0@lo:104: 00010000:00010000:3.0:1787098116.737806:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737850:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098116.737856:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:8457:x1873908077716480:12345-0@lo:104: Request processed in 64us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098116.737864:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787098116.737882:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787098116.737888:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72274b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077716608:12345-0@lo:104: 00010000:00010000:3.0:1787098116.737894:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737929:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787098116.737935:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72274b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077716608:12345-0@lo:104: Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098116.737940:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787098116.737985:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01445dd expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.737993:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01445dd expref: 18 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.738002:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716736:0@lo:104: 00000100:00100000:3.0:1787098116.738024:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098116.738043:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077716736 00000100:00100000:3.0:1787098116.738046:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077716736 00000100:00100000:3.0:1787098116.738061:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787098116.738065:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077716736:12345-0@lo:104: 00010000:00010000:3.0:1787098116.738072:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738101:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787098116.738106:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077716736:12345-0@lo:104: Request processed in 41us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098116.738111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1787098116.738125:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787098116.738130:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738138:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694400 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098116.738147:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738155:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098116.738163:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098116.738169:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787098116.738193:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738200:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098116.738223:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738231:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7208694400/0xb1d871f9b0144623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014462a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738244:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098116.738247:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738253:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695a00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098116.738256:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738263:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098116.738300:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098116.738306:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787098116.738321:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738327:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098116.738333:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738339:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01445f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144600 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738350:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098116.738353:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738357:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f090200 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098116.738360:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738366:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098116.738372:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098116.738377:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787098116.738397:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738403:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098116.738418:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738424:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d720f090200/0xb1d871f9b01445dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01445e4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738448:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098116.738450:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098116.738451:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098116.738464:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077716992:0@lo:103: 00000100:00100000:3.0:1787098116.738495:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098116.738522:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787098116.738527:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077716864:0@lo:103: 00000100:00100000:3.0:1787098116.738546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098116.738569:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787098116.738576:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077717120:0@lo:103: 00000100:00100000:3.0:1787098116.738597:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098116.738622:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077716992 00000100:00100000:3.0:1787098116.738626:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077716992 00010000:00010000:3.0:1787098116.738644:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01445f9 expref: 19 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.738657:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077716864 00000100:00100000:3.0:1787098116.738659:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077716864 00010000:00010000:3.0:1787098116.738668:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144623 expref: 20 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.738689:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077717120 00000100:00100000:3.0:1787098116.738691:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077717120 00010000:00010000:3.0:1787098116.738703:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01445dd expref: 21 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.738714:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787098116.738719:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+21:3310:x1873908077716992:12345-0@lo:103: 00010000:00010000:3.0:1787098116.738729:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098116.738733:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01445f9 expref: 21 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738742:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01445f9 expref: 21 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738756:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098116.738787:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+21:3310:x1873908077716992:12345-0@lo:103: Request processed in 68us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098116.738794:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787098116.738807:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787098116.738812:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+20:3310:x1873908077716864:12345-0@lo:103: 00010000:00010000:3.0:1787098116.738818:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098116.738822:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144623 expref: 20 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738830:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144623 expref: 20 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738840:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098116.738869:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+20:3310:x1873908077716864:12345-0@lo:103: Request processed in 56us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098116.738875:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787098116.738886:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787098116.738893:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077717120:12345-0@lo:103: 00010000:00010000:3.0:1787098116.738900:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098116.738905:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01445dd expref: 19 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738912:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01445dd expref: 19 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.738921:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098116.738945:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077717120:12345-0@lo:103: Request processed in 53us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098116.738950:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787098116.738985:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077717120:0@lo:103: 00000100:00100000:3.0:1787098116.739003:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077716864:0@lo:103: 00000100:00100000:3.0:1787098116.739009:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077716992:0@lo:103: 00010000:00010000:3.0:1787098116.739032:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01445cf expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739040:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01445cf expref: 18 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.739049:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077717248:0@lo:104: 00000100:00100000:3.0:1787098116.739068:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098116.739093:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077717248 00000100:00100000:3.0:1787098116.739097:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077717248 00000100:00100000:3.0:1787098116.739112:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787098116.739116:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077717248:12345-0@lo:104: 00010000:00010000:3.0:1787098116.739124:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739152:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098116.739157:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077717248:12345-0@lo:104: Request processed in 41us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098116.739163:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787098116.739174:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098116.739178:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739185:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204ec00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098116.739189:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739196:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098116.739202:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098116.739208:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787098116.739221:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739226:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098116.739242:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739248:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01445cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01445d6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739258:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098116.739260:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098116.739262:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098116.739270:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077717376:0@lo:103: 00000100:00100000:3.0:1787098116.739315:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098116.739340:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077717376 00000100:00100000:3.0:1787098116.739343:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077717376 00010000:00010000:3.0:1787098116.739356:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01445cf expref: 19 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.739372:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787098116.739377:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077717376:12345-0@lo:103: 00010000:00010000:3.0:1787098116.739384:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098116.739387:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01445cf expref: 19 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739394:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01445cf expref: 19 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739403:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098116.739426:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077717376:12345-0@lo:103: Request processed in 49us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098116.739444:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787098116.739468:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077717376:0@lo:103: 00010000:00010000:3.0:1787098116.739499:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01445c1 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.739508:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01445c1 expref: 18 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098116.739516:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077717504:0@lo:104: 00000100:00100000:3.0:1787098116.739537:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098116.739805:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077717504 00000100:00100000:1.0:1787098116.739810:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077717504 00000100:00100000:1.0:1787098116.739832:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787098116.739839:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077717504:12345-0@lo:104: 00010000:00010000:1.0:1787098116.739847:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.739884:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787098116.739889:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077717504:12345-0@lo:104: Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098116.739903:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787098116.739920:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098116.739925:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.739931:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f090a00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098116.739935:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.739942:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098116.739948:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098116.739953:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787098116.739970:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.739976:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098116.739987:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.739994:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b01445c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01445c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.740004:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098116.740006:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098116.740007:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098116.740012:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098116.740032:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787098116.740041:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077717632:0@lo:103: 00000100:00100000:1.0:1787098116.740081:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098116.740118:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077717632 00000100:00100000:1.0:1787098116.740121:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077717632 00010000:00010000:1.0:1787098116.740136:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01445c1 expref: 19 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098116.740155:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787098116.740161:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077717632:12345-0@lo:103: 00010000:00010000:1.0:1787098116.740169:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098116.740173:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01445c1 expref: 19 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.740181:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01445c1 expref: 19 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.740192:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098116.740217:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077717632:12345-0@lo:103: Request processed in 56us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098116.740223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787098116.740249:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077717632:0@lo:103: 00010000:00010000:1.0:1787098116.740262:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098116.745110:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144597 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098116.745129:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144597 expref: 18 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098116.745145:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077717760:0@lo:104: 00000100:00100000:2.0:1787098116.745229:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787098116.745362:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b014456d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098116.745372:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b014456d expref: 18 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098116.745381:0:8457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077717888:0@lo:104: 00000100:00100000:2.0:1787098116.745403:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098116.751728:0:8457:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203eaf840 going to sleep for 11 seconds 00000100:00100000:2.0:1787098116.751764:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716224:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098116.751774:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716352:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098116.751785:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208694600/0xb1d871f9b014462a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144623 expref: 18 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098116.751802:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716480:0@lo:104: 00010000:00010000:2.0:1787098116.751811:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208695c00/0xb1d871f9b0144600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01445f9 expref: 17 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098116.751820:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a83100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716608:0@lo:104: 00010000:00010000:2.0:1787098116.751828:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6000/0xb1d871f9b01445e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01445dd expref: 16 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098116.751837:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077716736:0@lo:104: 00010000:00010000:2.0:1787098116.751845:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200030400/0xb1d871f9b01445d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01445cf expref: 15 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098116.751853:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077717248:0@lo:104: 00010000:00010000:2.0:1787098116.751880:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01445c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01445c1 expref: 14 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098116.751890:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077717504:0@lo:104: 00000100:00100000:1.0:1787098116.752200:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077717760 00000100:00100000:1.0:1787098116.752208:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077717760 00000100:00100000:1.0:1787098116.752253:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077717888 00000100:00100000:1.0:1787098116.752255:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077717888 00000100:00100000:1.0:1787098116.752268:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787098116.752275:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:8457:x1873908077717760:12345-0@lo:104: 00010000:00010000:1.0:1787098116.752327:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.752403:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787098116.752409:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:8457:x1873908077717760:12345-0@lo:104: Request processed in 135us (7181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098116.752416:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787098116.752443:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787098116.752449:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077717888:12345-0@lo:104: 00010000:00010000:1.0:1787098116.752457:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.752487:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787098116.752492:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8457:x1873908077717888:12345-0@lo:104: Request processed in 44us (7089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098116.752498:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787098116.752514:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787098116.752519:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.752527:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030c00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098116.752531:0:6716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098116.752640:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098116.752646:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098116.752653:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:0.0:1787098116.752656:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098116.752665:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787098116.752673:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098116.752678:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787098116.752712:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098116.752718:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787098116.752741:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098116.752759:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d72421c7600/0xb1d871f9b014456d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144574 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098116.752772:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098116.752774:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098116.752776:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098116.752783:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098116.752794:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077718016:0@lo:103: 00000100:00100000:0.0:1787098116.752830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098116.752932:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077718016 00000100:00100000:0.0:1787098116.752937:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077718016 00010000:00010000:0.0:1787098116.752954:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014456d expref: 14 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098116.752973:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787098116.752978:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3309:x1873908077718016:12345-0@lo:103: 00010000:00010000:0.0:1787098116.752987:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098116.752992:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014456d expref: 14 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098116.753002:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b014456d expref: 14 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098116.753018:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098116.753041:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3309:x1873908077718016:12345-0@lo:103: Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098116.753047:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787098116.753079:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077718016:0@lo:103: 00000100:00100000:2.0:1787098116.753181:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077717760:0@lo:104: 00010000:00010000:2.0:1787098116.753189:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b014456d expref: 13 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098116.753199:0:8457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1873908077717888:0@lo:104: 00010000:00010000:2.0:1787098116.753232:0:8457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.753346:0:6716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098116.753354:0:6716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098116.753366:0:6716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787098116.753381:0:6716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.753387:0:6716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787098116.753421:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077718144:0@lo:103: 00000100:00100000:0.0:1787098116.753459:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787098116.753503:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.753511:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7200030c00/0xb1d871f9b0144597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014459e expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.753524:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098116.753526:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098116.753528:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098116.753556:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077718144 00000100:00100000:1.0:1787098116.753559:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077718144 00010000:00010000:1.0:1787098116.753573:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144597 expref: 13 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098116.753591:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787098116.753596:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d721fa99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:3311:x1873908077718144:12345-0@lo:103: 00010000:00010000:1.0:1787098116.753605:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098116.753609:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144597 expref: 13 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.753618:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144597 expref: 13 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.753628:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f090800/0xb1d871f9b014459e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144597 expref: 13 pid: 5836 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.753643:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098116.754346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098116.754365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098116.754917:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d721fa99050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:3311:x1873908077718144:12345-0@lo:103: Request processed in 1317us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098116.754928:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787098116.754980:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059869312 00000100:00100000:1.0:1787098116.754986:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059869312 00010000:00010000:1.0:1787098116.755005:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528733e expref: 10 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098116.755021:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059869184 00000100:00100000:1.0:1787098116.755023:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059869184 00010000:00010000:1.0:1787098116.755034:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287345 expref: 11 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098116.755046:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1787098116.755052:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:2374:x1873908059869312:12345-192.168.204.51@tcp:103: 00010000:00010000:1.0:1787098116.755061:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098116.755066:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528733e expref: 11 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755077:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528733e expref: 11 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755092:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6400/0xb1d871f9b0144638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528733e expref: 11 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755105:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098116.755158:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2374:x1873908059869312:12345-192.168.204.51@tcp:103: Request processed in 105us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098116.755177:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1787098116.755191:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1787098116.755197:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:2373:x1873908059869184:12345-192.168.204.51@tcp:103: 00010000:00010000:1.0:1787098116.755206:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098116.755210:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287345 expref: 9 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755220:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287345 expref: 9 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755230:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6600/0xb1d871f9b014463f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287345 expref: 9 pid: 5839 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755241:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755249:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755265:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755272:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755314:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755321:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755334:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098116.755338:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755346:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755363:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098116.755373:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098116.755395:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:2373:x1873908059869184:12345-192.168.204.51@tcp:103: Request processed in 198us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098116.755402:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00010000:00010000:3.0:1787098116.756041:0:8457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.756054:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098116.756061:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0144677 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098116.762069:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077718144:0@lo:103: 00010000:00010000:1.0:1787098117.519439:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098118.287789:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787098118.287814:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077718272:0@lo:13: 00000100:00100000:2.0:1787098118.287881:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098118.288038:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077718272 00000100:00100000:0.0:1787098118.288047:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077718272 00000100:00100000:0.0:1787098118.288121:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787098118.288132:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077718272:12345-0@lo:13: 00002000:00000024:0.0:1787098118.288168:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098118.288225:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077718272:12345-0@lo:13: Request processed in 95us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098118.288232:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787098118.288304:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787098118.289457:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227526300 x1873908077718272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098118.289481:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077718272:0@lo:13: 00010000:00010000:0.0:1787098118.544195:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787098118.671432:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787098118.671442:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d7104c23800 from 39 10000000:01000000:1.0:1787098118.671448:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787098118.671508:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.671520:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.671533:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098118.671563:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077718400:0@lo:101: 00000100:00100000:1.0:1787098118.672138:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.672353:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077718400 00000100:00100000:2.0:1787098118.672362:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077718400 00000100:00100000:2.0:1787098118.672436:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787098118.672445:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+12:5841:x1873908077718400:12345-0@lo:101: 00010000:00010000:2.0:1787098118.672464:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098118.672482:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014467e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.672526:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014467e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.672537:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014467e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.672546:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204ea00, rc 0) 00000100:00100000:1.0:1787098118.673440:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.674021:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077718400:12345-0@lo:101: Request processed in 1569us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.674033:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787098118.674202:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077718400:0@lo:101: 00010000:00010000:1.0:1787098118.674225:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.674237:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098118.674331:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077718528:0@lo:501: 00000100:00100000:1.0:1787098118.674367:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098118.674448:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.674545:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077718528 00000100:00100000:2.0:1787098118.674552:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077718528 00000100:00100000:2.0:1787098118.674634:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787098118.674653:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077718528:12345-0@lo:501: 00000100:00100000:2.0:1787098118.675121:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077718528:12345-0@lo:501: Request processed in 478us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.675129:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787098118.675199:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077718528:0@lo:501: 00000100:00100000:1.0:1787098118.675229:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077718656:0@lo:503: 00000100:00100000:1.0:1787098118.675270:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098118.675436:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098118.675661:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077718656 00000100:00100000:3.0:1787098118.675667:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077718656 00000100:00100000:3.0:1787098118.675695:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787098118.675701:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077718656:12345-0@lo:503: 00000100:00100000:3.0:1787098118.676031:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077718656:12345-0@lo:503: Request processed in 329us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098118.676039:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787098118.676219:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098118.676258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098118.676311:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098118.676343:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098118.676366:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059869824 00000100:00100000:1.0:1787098118.676371:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059869824 00000100:00100000:1.0:1787098118.676425:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059869696 00000100:00100000:1.0:1787098118.676428:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059869696 00000100:00100000:1.0:1787098118.676452:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1787098118.676459:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059869824:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1787098118.676508:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059869824:12345-192.168.204.51@tcp:400: Request processed in 49us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.676524:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1787098118.676537:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1787098118.676543:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059869696:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1787098118.676574:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059869696:12345-192.168.204.51@tcp:400: Request processed in 30us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.676580:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00080000:1.0:1787098118.676702:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098118.676707:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787098118.676715:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059869440 00000100:00100000:1.0:1787098118.676719:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059869440 00000100:00100000:1.0:1787098118.676736:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:1.0:1787098118.676742:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:2376:x1873908059869440:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1787098118.676775:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:2376:x1873908059869440:12345-192.168.204.51@tcp:400: Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.676782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:1.0:1787098118.676834:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077718656:0@lo:503: 00000100:00100000:1.0:1787098118.677073:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8476:1873908077718784:0@lo:502: 00000100:00100000:1.0:1787098118.677114:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098118.677138:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077718784 00000100:00100000:1.0:1787098118.677143:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077718784 00000100:00100000:1.0:1787098118.677160:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787098118.677165:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:8476:x1873908077718784:12345-0@lo:502: 00000100:00100000:1.0:1787098118.677386:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:8476:x1873908077718784:12345-0@lo:502: Request processed in 220us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.677414:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787098118.677456:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.677469:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8476:1873908077718784:0@lo:502: 00000100:00100000:1.0:1787098118.677511:0:8476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8476:1873908077718912:0@lo:502: 00000100:00100000:1.0:1787098118.677542:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098118.677561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077718912 00000100:00100000:1.0:1787098118.677563:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077718912 00000100:00100000:1.0:1787098118.677580:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787098118.677599:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:8476:x1873908077718912:12345-0@lo:502: 00000100:00100000:1.0:1787098118.677715:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:8476:x1873908077718912:12345-0@lo:502: Request processed in 129us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.677721:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787098118.677753:0:8476:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.677763:0:8476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8476:1873908077718912:0@lo:502: 00000040:00080000:1.0:1787098118.677780:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787098118.677831:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787098118.677846:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787098118.677855:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.677866:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098118.677875:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787098118.677877:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787098118.677880:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787098118.677910:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.677918:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.677926:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098118.677938:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719040:0@lo:101: 00000100:00100000:1.0:1787098118.677961:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098118.677975:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.677987:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077719040 00000100:00100000:1.0:1787098118.677990:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077719040 00000100:00100000:1.0:1787098118.678006:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787098118.678011:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+13:5841:x1873908077719040:12345-0@lo:101: 00010000:00010000:1.0:1787098118.678020:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098118.678033:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d720f091a00/0xb1d871f9b0144693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014468c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.678053:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d720f091a00/0xb1d871f9b0144693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014468c expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.678063:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d720f091a00/0xb1d871f9b0144693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014468c expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.678073:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d720f091a00, rc 0) 00000100:00100000:1.0:1787098118.678101:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077719040:12345-0@lo:101: Request processed in 87us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.678106:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787098118.678145:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719040:0@lo:101: 00010000:00010000:1.0:1787098118.678156:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.678165:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098118.678203:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719168:0@lo:501: 00000100:00100000:1.0:1787098118.678226:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098118.678248:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.678259:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077719168 00000100:00100000:1.0:1787098118.678262:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077719168 00000100:00100000:1.0:1787098118.678303:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787098118.678310:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077719168:12345-0@lo:501: 00000100:00100000:1.0:1787098118.678519:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077719168:12345-0@lo:501: Request processed in 209us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.678526:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787098118.678552:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719168:0@lo:501: 00000100:00100000:1.0:1787098118.678575:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719296:0@lo:503: 00000100:00100000:1.0:1787098118.678609:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098118.678628:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.678639:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077719296 00000100:00100000:1.0:1787098118.678643:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077719296 00000100:00100000:1.0:1787098118.678658:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787098118.678663:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077719296:12345-0@lo:503: 00000100:00100000:1.0:1787098118.678782:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077719296:12345-0@lo:503: Request processed in 118us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.678797:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787098118.678831:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719296:0@lo:503: 00000100:00100000:3.0:1787098118.680038:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059869568 00000100:00100000:3.0:1787098118.680050:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059869568 00000100:00100000:3.0:1787098118.680116:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:3.0:1787098118.680126:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059869568:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1787098118.680210:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059869568:12345-192.168.204.51@tcp:400: Request processed in 85us (3992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098118.680217:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00080000:3.0:1787098118.680238:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098118.681407:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8477:1873908077719424:0@lo:502: 00000100:00100000:1.0:1787098118.681496:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098118.681548:0:8477:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66300 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.681663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077719424 00000100:00100000:2.0:1787098118.681670:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077719424 00000100:00100000:2.0:1787098118.681712:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787098118.681720:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:8477:x1873908077719424:12345-0@lo:502: 00000100:00100000:2.0:1787098118.681974:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:8477:x1873908077719424:12345-0@lo:502: Request processed in 252us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.681982:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787098118.682300:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8477:1873908077719424:0@lo:502: 00000020:01000000:1.0:1787098118.682332:0:8477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098118.682341:0:8477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098118.682344:0:8477:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787098118.682349:0:8477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787098118.682373:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8477:1873908077719552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098118.682492:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098118.682513:0:8477:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66300 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.682567:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077719552 00000100:00100000:2.0:1787098118.682572:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077719552 00000100:00100000:2.0:1787098118.682607:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787098118.682621:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:8477:x1873908077719552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098118.682765:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:8477:x1873908077719552:12345-0@lo:502:llog_process_th.0 Request processed in 144us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.682772:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787098118.683027:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8477:1873908077719552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787098118.683050:0:8477:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098118.683056:0:8477:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098118.683057:0:8477:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787098118.683061:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787098118.683228:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787098118.683247:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787098118.683257:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.683267:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098118.683275:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787098118.683312:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d7227639800 from 39 10000000:01000000:2.0:1787098118.683315:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787098118.683342:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.683351:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.683359:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098118.683376:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.685736:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.685776:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.685888:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077719680 00000100:00100000:1.0:1787098118.685898:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077719680 00000100:00100000:1.0:1787098118.685958:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787098118.685969:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:5841:x1873908077719680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098118.685988:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098118.686011:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d720f090200/0xb1d871f9b01446a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014469a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.686060:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d720f090200/0xb1d871f9b01446a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014469a expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.686070:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d720f090200/0xb1d871f9b01446a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014469a expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.686079:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d720f090200, rc 0) 00000100:00100000:1.0:1787098118.686143:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077719680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.686150:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787098118.686683:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098118.686703:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098118.686713:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098118.686782:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098118.686818:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098118.686988:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203eaf480 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.687028:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077719808 00000100:00100000:2.0:1787098118.687033:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077719808 00000100:00100000:2.0:1787098118.687116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787098118.687125:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077719808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.687430:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077719808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.687438:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787098118.687506:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098118.687538:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098118.687589:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098118.688188:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203eaf480 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.688237:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077719936 00000100:00100000:1.0:1787098118.688243:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077719936 00000100:00100000:1.0:1787098118.688413:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787098118.688423:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077719936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098118.688754:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077719936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 332us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.688762:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787098118.688873:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077719936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.689198:0:8478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8478:1873908077720064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098118.689246:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.689462:0:8478:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.689500:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077720064 00000100:00100000:1.0:1787098118.689506:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077720064 00000100:00100000:1.0:1787098118.689695:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787098118.689706:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:8478:x1873908077720064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098118.690203:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:8478:x1873908077720064:12345-0@lo:502:llog_process_th.0 Request processed in 497us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.690211:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787098118.692659:0:8478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8478:1873908077720064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098118.692753:0:8478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8478:1873908077720192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098118.692824:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098118.692866:0:8478:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203eaf480 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.693432:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077720192 00000100:00100000:2.0:1787098118.693441:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077720192 00000100:00100000:2.0:1787098118.693486:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787098118.693495:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:8478:x1873908077720192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098118.693861:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:8478:x1873908077720192:12345-0@lo:502:llog_process_th.0 Request processed in 366us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.693870:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787098118.694419:0:8478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8478:1873908077720192:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787098118.694462:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787098118.694764:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787098118.694783:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787098118.694794:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.694804:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098118.694812:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787098118.694815:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787098118.694818:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787098118.695035:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.695052:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.695062:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098118.695084:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077720320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.695133:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.695175:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098118.695233:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077720320 00000100:00100000:3.0:1787098118.695239:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077720320 00000100:00100000:3.0:1787098118.695384:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787098118.695405:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:5841:x1873908077720320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098118.695418:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098118.695433:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b01446af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01446a8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098118.695457:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b01446af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01446a8 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098118.695468:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b01446af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01446a8 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098118.695476:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6a00, rc 0) 00000100:00100000:3.0:1787098118.695516:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077720320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098118.695523:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787098118.695736:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077720320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098118.695749:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.695758:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098118.695815:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077720448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.695840:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.695925:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.696156:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077720448 00000100:00100000:1.0:1787098118.696162:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077720448 00000100:00100000:1.0:1787098118.696199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787098118.696205:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077720448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098118.696508:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077720448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.696515:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787098118.696808:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077720448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.696843:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077720576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.696885:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.696920:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.698608:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077720576 00000100:00100000:1.0:1787098118.698623:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077720576 00000100:00100000:1.0:1787098118.698680:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787098118.698690:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077720576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098118.698957:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077720576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.698965:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787098118.699016:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077720576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787098118.699654:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8479:1873908077720704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098118.699712:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098118.699789:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098118.701005:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077720704 00000100:00100000:3.0:1787098118.701018:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077720704 00000100:00100000:3.0:1787098118.701113:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787098118.701123:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:8479:x1873908077720704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098118.701414:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:8479:x1873908077720704:12345-0@lo:502:llog_process_th.0 Request processed in 291us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098118.701422:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787098118.701579:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8479:1873908077720704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787098118.701612:0:8479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787098118.701622:0:8479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098118.701624:0:8479:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787098118.701629:0:8479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787098118.701659:0:8479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8479:1873908077720832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098118.701699:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098118.701741:0:8479:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.701742:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077720832 00000100:00100000:2.0:1787098118.701747:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077720832 00000100:00100000:2.0:1787098118.701788:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787098118.701795:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:8479:x1873908077720832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098118.701941:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:8479:x1873908077720832:12345-0@lo:502:llog_process_th.0 Request processed in 145us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.701948:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787098118.702136:0:8479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8479:1873908077720832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787098118.702157:0:8479:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098118.702161:0:8479:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098118.702163:0:8479:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787098118.702167:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787098118.702547:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787098118.702565:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787098118.702576:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.702588:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098118.702598:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787098118.702601:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d72079cb000 from 39 10000000:01000000:2.0:1787098118.702604:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787098118.702630:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.702637:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.702646:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098118.702662:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077720960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.702696:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.702762:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.702802:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077720960 00000100:00100000:1.0:1787098118.702808:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077720960 00000100:00100000:1.0:1787098118.702951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787098118.702960:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077720960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098118.702971:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098118.702983:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d720f090800/0xb1d871f9b01446bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01446b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.703007:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d720f090800/0xb1d871f9b01446bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01446b6 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.703018:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d720f090800/0xb1d871f9b01446bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01446b6 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.703026:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d720f090800, rc 0) 00000100:00100000:1.0:1787098118.703069:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077720960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.703084:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787098118.703146:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077720960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098118.703157:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098118.703166:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098118.703214:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098118.703240:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098118.703641:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.703670:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077721088 00000100:00100000:2.0:1787098118.703685:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077721088 00000100:00100000:2.0:1787098118.703710:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787098118.703715:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077721088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.704060:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077721088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.704068:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787098118.704144:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098118.704179:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787098118.704218:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098118.704246:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098118.704317:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077721216 00000100:00100000:3.0:1787098118.704321:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077721216 00000100:00100000:3.0:1787098118.704350:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787098118.704357:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077721216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098118.704524:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077721216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098118.704532:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787098118.704725:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098118.705102:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8480:1873908077721344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098118.705143:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098118.705179:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203eaf780 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.705227:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077721344 00000100:00100000:2.0:1787098118.705232:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077721344 00000100:00100000:2.0:1787098118.705265:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787098118.705272:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:8480:x1873908077721344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098118.705647:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:8480:x1873908077721344:12345-0@lo:502:llog_process_th.0 Request processed in 374us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.705655:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787098118.705739:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8480:1873908077721344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098118.705781:0:8480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8480:1873908077721472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098118.705814:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098118.705840:0:8480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203eaf780 going to sleep for 11 seconds 00000100:00100000:0.0:1787098118.705947:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077721472 00000100:00100000:0.0:1787098118.705952:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077721472 00000100:00100000:0.0:1787098118.705985:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787098118.705992:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:8480:x1873908077721472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098118.706150:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:8480:x1873908077721472:12345-0@lo:502:llog_process_th.0 Request processed in 157us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098118.706166:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787098118.706314:0:8480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8480:1873908077721472:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787098118.706334:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787098118.706631:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787098118.706650:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787098118.706660:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098118.706671:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098118.706680:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787098118.706683:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787098118.706686:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787098118.706710:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098118.706717:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098118.706726:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098118.706742:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787098118.706773:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098118.706838:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.706963:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077721600 00000100:00100000:1.0:1787098118.706968:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077721600 00000100:00100000:1.0:1787098118.707026:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787098118.707033:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077721600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098118.707043:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098118.707068:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227412a00/0xb1d871f9b01446cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01446c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.707089:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227412a00/0xb1d871f9b01446cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01446c4 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.707098:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227412a00/0xb1d871f9b01446cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01446c4 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098118.707106:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412a00, rc 0) 00000100:00100000:1.0:1787098118.707147:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077721600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.707153:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787098118.707243:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098118.707255:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098118.707264:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098118.707373:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098118.707535:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098118.707563:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203eaf780 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.707643:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077721728 00000100:00100000:1.0:1787098118.707647:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077721728 00000100:00100000:1.0:1787098118.707674:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787098118.707679:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077721728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098118.707992:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077721728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.707999:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787098118.708059:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.708088:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.708123:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.708146:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203f39240 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.708203:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077721856 00000100:00100000:1.0:1787098118.708213:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077721856 00000100:00100000:1.0:1787098118.708244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787098118.708250:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077721856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098118.708427:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077721856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.708433:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787098118.708574:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077721856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.709079:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8481:1873908077721984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098118.709121:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.709153:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203f39600 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.709200:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077721984 00000100:00100000:1.0:1787098118.709205:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077721984 00000100:00100000:1.0:1787098118.709238:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787098118.709244:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8481:x1873908077721984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098118.709581:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8481:x1873908077721984:12345-0@lo:502:llog_process_th.0 Request processed in 335us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098118.709589:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787098118.709662:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8481:1873908077721984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787098118.709688:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787098118.709696:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098118.709699:0:8481:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787098118.709712:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787098118.709735:0:8481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8481:1873908077722112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098118.709770:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098118.709803:0:8481:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787098118.709930:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077722112 00000100:00100000:2.0:1787098118.709934:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077722112 00000100:00100000:2.0:1787098118.709967:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787098118.709974:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8481:x1873908077722112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098118.710119:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8481:x1873908077722112:12345-0@lo:502:llog_process_th.0 Request processed in 145us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098118.710125:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787098118.710198:0:8481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8481:1873908077722112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787098118.710219:0:8481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098118.710223:0:8481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098118.710225:0:8481:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787098118.710228:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787098118.710419:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787098118.710437:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787098118.710447:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.710457:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098118.710467:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787098118.710470:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d7208e14d40 from 1 10000000:01000000:2.0:1787098118.710472:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787098118.710494:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.710501:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.710509:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098118.710523:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077722240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.710553:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.710583:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203f393c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098118.710689:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077722240 00000100:00100000:0.0:1787098118.710694:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077722240 00000100:00100000:0.0:1787098118.710730:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787098118.710737:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077722240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098118.710747:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098118.710758:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208694800/0xb1d871f9b01446d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01446d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098118.710781:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208694800/0xb1d871f9b01446d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01446d2 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098118.710791:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208694800/0xb1d871f9b01446d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01446d2 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098118.710799:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694800, rc 0) 00000100:00100000:0.0:1787098118.710830:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077722240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098118.710835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787098118.711045:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077722240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098118.711059:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.711077:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01446d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098118.711128:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077722368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098118.711154:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098118.711179:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203f393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098118.711226:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077722368 00000100:00100000:1.0:1787098118.711230:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077722368 00000100:00100000:1.0:1787098118.711261:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787098118.711268:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077722368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098118.711517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077722368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (361us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787098118.711525:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787098118.711651:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077722368:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787098118.711676:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787098118.711682:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098118.711690:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098119.570430:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098120.592292:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098120.847765:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077722496:0@lo:400:kworker.0 00000100:00100000:2.0:1787098120.847782:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077722752:0@lo:400:kworker.0 00000100:00100000:1.0:1787098120.847869:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077722624:0@lo:400:kworker.0 00000100:00100000:3.0:1787098120.847887:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077722880:0@lo:400:kworker.0 00000100:00100000:0.0:1787098120.848726:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098120.848787:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1873908077723008:0@lo:400:kworker.0 00000100:00100000:0.0:1787098120.848815:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098120.848926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077722496 00000100:00100000:0.0:1787098120.848934:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077722496 00000100:00100000:0.0:1787098120.848977:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787098120.848985:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077722496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098120.849130:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077722496:12345-0@lo:400:kworker.0 Request processed in 145us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098120.849138:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787098120.849197:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077722496:0@lo:400:kworker.0 00000100:00100000:0.0:1787098120.849238:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077723008 00000100:00100000:0.0:1787098120.849241:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077723008 00000100:00100000:0.0:1787098120.849315:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787098120.849334:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873908077723008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098120.849389:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873908077723008:12345-0@lo:400:kworker.0 Request processed in 67us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098120.849397:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787098120.849416:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098120.849443:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1873908077723008:0@lo:400:kworker.0 00000100:00100000:1.0:1787098120.850727:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098120.850835:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077723136:0@lo:400:kworker.0 00000100:00100000:1.0:1787098120.850873:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098120.850972:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077723136 00000100:00100000:1.0:1787098120.850979:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077723136 00000100:00100000:2.0:1787098120.851046:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098120.851122:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098120.851230:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077722880 00000100:00100000:3.0:1787098120.851235:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077722880 00000100:00100000:1.0:1787098120.851309:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787098120.851319:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077723136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098120.851382:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077723136:12345-0@lo:400:kworker.0 Request processed in 65us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098120.851389:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787098120.851483:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787098120.851492:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077722880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098120.851598:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077722880:12345-0@lo:400:kworker.0 Request processed in 107us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098120.851606:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787098120.851644:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207df3480 x1873908077722880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098120.851656:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077722880:0@lo:400:kworker.0 00000100:00080000:3.0:1787098120.851692:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787098120.851695:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787098120.853974:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077722624 00000100:00100000:3.0:1787098120.853987:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077722752 00000100:00100000:0.0:1787098120.853989:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077722624 00000100:00100000:3.0:1787098120.853991:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077722752 00000100:00080000:2.0:1787098120.854177:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098120.854189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787098120.854205:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077722752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098120.854222:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787098120.854228:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077722624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098120.854295:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077722624:12345-0@lo:400:kworker.0 Request processed in 51us (3559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098120.854305:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077722752:12345-0@lo:400:kworker.0 Request processed in 110us (3259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098120.854313:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787098120.854317:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787098120.854374:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077722752:0@lo:400:kworker.0 00000100:00100000:0.0:1787098120.854374:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077722624:0@lo:400:kworker.0 00010000:00080000:0.0:1787098120.854391:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207df1f80 x1873908077723136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098120.854401:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077723136:0@lo:400:kworker.0 00000100:00100000:3.0:1787098121.359973:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098121.360060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098121.360258:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077723264 00000100:00100000:0.0:1787098121.360268:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077723264 00000100:00100000:0.0:1787098121.360355:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787098121.360367:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077723264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098121.360405:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098121.360466:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077723264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098121.360473:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787098121.360709:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525f80 x1873908077723264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098121.360750:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077723264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787098121.615539:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098122.639480:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098123.284680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098123.284950:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059869952 00000100:00100000:2.0:1787098123.284962:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059869952 00000100:00100000:2.0:1787098123.285030:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:2.0:1787098123.285040:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:5612:x1873908059869952:12345-192.168.204.51@tcp:101: 00010000:00010000:2.0:1787098123.285057:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098123.285076:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204e800/0xb1d871f9b01446e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e52873a7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098123.285109:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204e800/0xb1d871f9b01446e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873a7 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098123.285139:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204e800/0xb1d871f9b01446e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873a7 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098123.285150:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204e800, rc 0) 00000100:00100000:2.0:1787098123.285273:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5612:x1873908059869952:12345-192.168.204.51@tcp:101: Request processed in 235us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098123.285325:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:3.0:1787098123.296141:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098123.296393:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059870080 00000100:00100000:0.0:1787098123.296402:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059870080 00000100:00100000:0.0:1787098123.296473:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:0.0:1787098123.296482:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5612:x1873908059870080:12345-192.168.204.51@tcp:501: 00000100:00100000:0.0:1787098123.296794:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5612:x1873908059870080:12345-192.168.204.51@tcp:501: Request processed in 312us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098123.296802:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:1.0:1787098123.298894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098123.298985:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059870208 00000100:00100000:0.0:1787098123.298996:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059870208 00000100:00100000:0.0:1787098123.299156:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:0.0:1787098123.299167:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5612:x1873908059870208:12345-192.168.204.51@tcp:503: 00000100:00100000:0.0:1787098123.299441:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5612:x1873908059870208:12345-192.168.204.51@tcp:503: Request processed in 276us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098123.299449:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:1.0:1787098123.302333:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098123.302467:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059870336 00000100:00100000:2.0:1787098123.302477:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059870336 00000100:00100000:2.0:1787098123.302532:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:2.0:1787098123.302541:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:6109:x1873908059870336:12345-192.168.204.51@tcp:502: 00000100:00100000:2.0:1787098123.302806:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:6109:x1873908059870336:12345-192.168.204.51@tcp:502: Request processed in 265us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098123.302815:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:3.0:1787098123.305604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098123.305982:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059870464 00000100:00100000:2.0:1787098123.305993:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059870464 00000100:00100000:2.0:1787098123.306060:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:2.0:1787098123.306070:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:6109:x1873908059870464:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787098123.306392:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:6109:x1873908059870464:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 321us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098123.306400:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:3.0:1787098123.311087:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098123.312154:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059870592 00000100:00100000:0.0:1787098123.312166:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059870592 00000100:00100000:0.0:1787098123.312229:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:0.0:1787098123.312239:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5612:x1873908059870592:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098123.312256:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098123.312274:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208694200/0xb1d871f9b01446e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e52873ae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098123.312536:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208694200/0xb1d871f9b01446e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ae expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098123.312548:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208694200/0xb1d871f9b01446e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ae expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098123.312557:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694200, rc 0) 00000100:00100000:0.0:1787098123.312664:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5612:x1873908059870592:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 426us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098123.312672:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:3.0:1787098123.314789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098123.314869:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059870720 00000100:00100000:0.0:1787098123.314878:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059870720 00000100:00100000:0.0:1787098123.314935:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:0.0:1787098123.314947:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5612:x1873908059870720:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098123.316730:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5612:x1873908059870720:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 1775us (1940us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787098123.316760:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:3.0:1787098123.407771:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787098123.407797:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077723392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098123.407873:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098123.408032:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077723392 00000100:00100000:0.0:1787098123.408041:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077723392 00000100:00100000:0.0:1787098123.408121:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787098123.408133:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077723392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098123.408168:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098123.408221:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077723392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098123.408230:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787098123.408271:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227524000 x1873908077723392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098123.408323:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077723392:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787098123.408428:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787098123.665448:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098123.797420:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098123.797462:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098123.797497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098123.797529:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059871104 00000100:00100000:3.0:1787098123.797540:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059871104 00000100:00100000:3.0:1787098123.797594:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059870976 00000100:00100000:3.0:1787098123.797598:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059870976 00000100:00100000:3.0:1787098123.797624:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1787098123.797634:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059871104:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098123.797697:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059871104:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 64us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098123.797704:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1787098123.797720:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1787098123.797727:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059870976:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098123.797753:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059870976:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098123.797758:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00080000:2.0:1787098123.797932:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787098123.797938:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787098123.798373:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059870848 00000100:00100000:0.0:1787098123.798378:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059870848 00000100:00100000:0.0:1787098123.798436:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:0.0:1787098123.798444:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2375:x1873908059870848:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098123.798499:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2375:x1873908059870848:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 56us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098123.798506:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00080000:2.0:1787098123.798721:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787098124.216889:0:8520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9b1fed60 20000000:00000080:2.0:1787098124.216909:0:8520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d723ba22800 uarg=0000000000000000 20000000:01000000:2.0:1787098124.216947:0:8520:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787098124.216953:0:8520:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787098124.216957:0:8520:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787098124.222558:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787098124.223142:0:8520:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787098124.232275:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787098124.232877:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787098124.232942:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787098124.232963:0:8520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787098124.232983:0:8520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.233100:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d720f091400/0xb1d871f9b0144463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014445c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.233108:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01444be expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.233115:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144589 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.233125:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287376 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.233132:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.233173:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287376 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.233190:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287376 expref: 9 pid: 5839 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098124.233205:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873908077723520:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098124.233528:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144589 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.233538:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144589 expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098124.233547:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873908077723648:0@lo:104: 00000100:00100000:0.0:1787098124.233593:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787098124.233638:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01444be expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.233647:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01444be expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098124.233655:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873908077723776:0@lo:104: 00000100:00100000:0.0:1787098124.233681:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098124.233720:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787098124.233744:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077723648 00000100:00100000:0.0:1787098124.233751:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077723648 00000100:00100000:1.0:1787098124.233877:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077723776 00000100:00100000:1.0:1787098124.233883:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077723776 00000100:00100000:1.0:1787098124.233926:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787098124.233936:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8520:x1873908077723776:12345-0@lo:104: 00010000:00010000:1.0:1787098124.233948:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.233995:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787098124.234001:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8520:x1873908077723776:12345-0@lo:104: Request processed in 67us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098124.234009:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787098124.234034:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098124.234039:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.234047:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030600 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098124.234051:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.234065:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098124.234073:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098124.234079:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787098124.234113:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.234119:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098124.234140:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.234148:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7200030600/0xb1d871f9b01444be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01444c5 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.234161:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098124.234163:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098124.234164:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098124.234175:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077723904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787098124.234203:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098124.234234:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077723904 00000100:00100000:1.0:1787098124.234238:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077723904 00010000:00010000:1.0:1787098124.234253:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01444be expref: 19 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098124.234273:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787098124.234312:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077723904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787098124.234339:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098124.234345:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01444be expref: 19 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.234353:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01444be expref: 19 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.234368:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098124.234397:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077723904:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098124.234403:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787098124.234600:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787098124.234608:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8520:x1873908077723648:12345-0@lo:104: 00010000:00010000:0.0:1787098124.234617:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.234666:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787098124.234672:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8520:x1873908077723648:12345-0@lo:104: Request processed in 65us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098124.234677:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787098124.234739:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d720f091400/0xb1d871f9b0144463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b014445c expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.234748:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d720f091400/0xb1d871f9b0144463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b014445c expref: 18 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098124.234771:0:8520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873908077724032:0@lo:104: 00000100:00100000:0.0:1787098124.234801:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098124.234825:0:8520:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72031190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098124.234848:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873908077723648:0@lo:104: 00010000:00010000:0.0:1787098124.234860:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204f600/0xb1d871f9b01444c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01444be expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098124.234872:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873908077723776:0@lo:104: 00000100:00100000:1.0:1787098124.234993:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077723904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098124.235005:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098124.235013:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.235021:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204fa00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098124.235025:0:6716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.235034:0:6716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098124.235041:0:6716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098124.235047:0:6716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787098124.235077:0:6716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.235085:0:6716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098124.235102:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.235109:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204fa00/0xb1d871f9b0144589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144590 expref: -99 pid: 7643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.235132:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098124.235134:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098124.235136:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098124.235141:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077724160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787098124.235151:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077724032 00000100:00100000:2.0:1787098124.235157:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077724032 00000100:00100000:1.0:1787098124.235175:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098124.235192:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787098124.235202:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8520:x1873908077724032:12345-0@lo:104: 00010000:00010000:2.0:1787098124.235211:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098124.235214:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077724160 00000100:00100000:1.0:1787098124.235219:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077724160 00010000:00010000:1.0:1787098124.235240:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144589 expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.235264:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787098124.235264:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787098124.235273:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:8520:x1873908077724032:12345-0@lo:104: Request processed in 73us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098124.235275:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:3310:x1873908077724160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787098124.235323:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787098124.235378:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098124.235385:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144589 expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.235492:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144589 expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.235514:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200031200/0xb1d871f9b0144590 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144589 expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.235524:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098124.235563:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:3310:x1873908077724160:12345-0@lo:103:ldlm_bl.0 Request processed in 290us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098124.235569:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787098124.235588:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098124.235593:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.235600:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098124.235603:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.235610:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098124.235617:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098124.235622:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787098124.235640:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098124.235647:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077724160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787098124.235648:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098124.235670:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.235678:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d72421c7c00/0xb1d871f9b014445c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144463 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.235701:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098124.235703:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098124.235704:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098124.235715:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077724288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787098124.235740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098124.235914:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873908077724032:0@lo:104: 00000100:00100000:1.0:1787098124.238962:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077724288 00000100:00100000:1.0:1787098124.238975:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077724288 00010000:00010000:1.0:1787098124.239009:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d720f091400/0xb1d871f9b0144463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014445c expref: 17 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098124.239040:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787098124.239047:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:3311:x1873908077724288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787098124.239060:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098124.239066:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d720f091400/0xb1d871f9b0144463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014445c expref: 17 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.239077:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d720f091400/0xb1d871f9b0144463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b014445c expref: 17 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.239093:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f091400/0xb1d871f9b0144463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b014445c expref: 17 pid: 5836 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.239106:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098124.239164:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3311:x1873908077724288:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (3423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098124.239172:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787098124.239211:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077724288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098124.239773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098124.239970:0:8520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1873908077723520:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098124.239999:0:8520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098124.240070:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059871232 00000100:00100000:2.0:1787098124.240076:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059871232 00010000:00010000:2.0:1787098124.240101:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287376 expref: 10 pid: 5839 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098124.240135:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1787098124.240143:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2373:x1873908059871232:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098124.240153:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098124.240158:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287376 expref: 10 pid: 5839 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240183:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287376 expref: 10 pid: 5839 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240196:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6e00/0xb1d871f9b014464d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287376 expref: 10 pid: 5839 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240210:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240218:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240231:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240237:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240244:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240250:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240257:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098124.240261:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240268:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240328:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098124.240338:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787098124.240349:0:8520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.240359:0:8520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098124.240367:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208695800/0xb1d871f9b01446ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098124.240389:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:2373:x1873908059871232:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 245us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098124.240397:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00010000:00010000:1.0:1787098124.693229:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098124.951194:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098124.951323:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059871360 00000100:00100000:1.0:1787098124.951334:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059871360 00000100:00100000:1.0:1787098124.951391:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:1.0:1787098124.951402:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:5612:x1873908059871360:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098124.951419:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098124.951439:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e52873b5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.951466:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873b5 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.951478:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873b5 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098124.951487:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413c00, rc 0) 00000100:00100000:1.0:1787098124.951544:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5612:x1873908059871360:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 144us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098124.951551:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:3.0:1787098124.954329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098124.954427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059871488 00000100:00100000:0.0:1787098124.954436:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059871488 00000100:00100000:0.0:1787098124.954529:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:0.0:1787098124.954540:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5612:x1873908059871488:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098124.954911:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5612:x1873908059871488:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 371us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098124.954918:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:0.0:1787098124.958817:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098124.958859:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059871616 00000100:00100000:0.0:1787098124.958869:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059871616 00000100:00100000:0.0:1787098124.958924:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:0.0:1787098124.958934:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5612:x1873908059871616:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787098124.959168:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:5612:x1873908059871616:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 234us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098124.959177:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:0.0:1787098124.966636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098124.966924:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059871744 00000100:00100000:1.0:1787098124.966934:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059871744 00000100:00100000:1.0:1787098124.966997:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:1.0:1787098124.967007:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:6166:x1873908059871744:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787098124.967253:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:6166:x1873908059871744:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 245us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098124.967261:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:3.0:1787098124.972053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098124.972315:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059871872 00000100:00100000:0.0:1787098124.972324:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059871872 00000100:00100000:0.0:1787098124.972496:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:0.0:1787098124.972507:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:6166:x1873908059871872:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098124.972744:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:6166:x1873908059871872:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 238us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098124.972752:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 174 10000000:01000000:1.0:1787098125.649123:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787098125.649130:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7104c23800 from 4 10000000:01000000:1.0:1787098125.649134:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787098125.649172:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.649184:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.649196:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098125.649219:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077724416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.649312:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.649351:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828180 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.649370:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077724416 00000100:00100000:1.0:1787098125.649375:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077724416 00000100:00100000:1.0:1787098125.649414:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787098125.649422:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077724416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098125.649434:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098125.649445:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01446fc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.649465:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01446fc expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.649492:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01446fc expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.649500:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413000, rc 0) 00000100:00100000:1.0:1787098125.649532:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077724416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.649539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787098125.649582:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077724416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098125.649594:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.649603:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098125.649717:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077724544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.649741:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.649755:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828180 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.649767:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077724544 00000100:00100000:1.0:1787098125.649770:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077724544 00000100:00100000:1.0:1787098125.649787:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787098125.649792:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077724544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.650095:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077724544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.650102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787098125.650159:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077724544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098125.650185:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077724672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098125.650217:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098125.650236:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203eaf540 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.651722:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077724672 00000100:00100000:1.0:1787098125.651733:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077724672 00000100:00100000:1.0:1787098125.651787:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787098125.651796:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077724672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.651985:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077724672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.651992:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787098125.652045:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077724672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.652216:0:8594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8594:1873908077724800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098125.652250:0:8594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.652305:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077724800 00000100:00100000:1.0:1787098125.652310:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077724800 00000100:00100000:1.0:1787098125.652333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787098125.652339:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:8594:x1873908077724800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098125.652453:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:8594:x1873908077724800:12345-0@lo:502:llog_process_th.0 Request processed in 113us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.652460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787098125.652497:0:8594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204b15a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.652511:0:8594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8594:1873908077724800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787098125.652530:0:8594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098125.652540:0:8594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098125.652542:0:8594:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787098125.652547:0:8594:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7104c23800 00000020:00000080:1.0:1787098125.652550:0:8594:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787098125.652609:0:8594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8594:1873908077724928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098125.652640:0:8594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.652657:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077724928 00000100:00100000:1.0:1787098125.652667:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077724928 00000100:00100000:1.0:1787098125.652684:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787098125.652689:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:8594:x1873908077724928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098125.652775:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:8594:x1873908077724928:12345-0@lo:502:llog_process_th.0 Request processed in 85us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.652781:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787098125.652805:0:8594:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206767300 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.652816:0:8594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8594:1873908077724928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787098125.652831:0:8594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098125.652835:0:8594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098125.652836:0:8594:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787098125.652840:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787098125.652879:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787098125.652893:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787098125.652902:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.652913:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098125.652923:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787098125.652925:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7227639800 from 4 10000000:01000000:1.0:1787098125.652928:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787098125.652949:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.652957:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.652966:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098125.652985:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.653009:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.653022:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206767300 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.653033:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077725056 00000100:00100000:1.0:1787098125.653036:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077725056 00000100:00100000:1.0:1787098125.653055:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787098125.653061:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077725056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098125.653068:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098125.653081:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014470a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.653099:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014470a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.653109:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014470a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.653117:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413800, rc 0) 00000100:00100000:1.0:1787098125.653143:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077725056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.653149:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787098125.653176:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098125.653186:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.653195:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098125.653235:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.653255:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.653294:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206767300 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.653304:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077725184 00000100:00100000:1.0:1787098125.653307:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077725184 00000100:00100000:1.0:1787098125.653324:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787098125.653329:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077725184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.653516:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077725184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.653523:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787098125.653553:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.653578:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.653612:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.653625:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206767300 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.653636:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077725312 00000100:00100000:1.0:1787098125.653639:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077725312 00000100:00100000:1.0:1787098125.653660:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787098125.653665:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077725312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.653763:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077725312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.653768:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787098125.653801:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.653983:0:8595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8595:1873908077725440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098125.654019:0:8595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.654036:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077725440 00000100:00100000:1.0:1787098125.654039:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077725440 00000100:00100000:1.0:1787098125.654059:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787098125.654064:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8595:x1873908077725440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098125.654166:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8595:x1873908077725440:12345-0@lo:502:llog_process_th.0 Request processed in 101us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.654173:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787098125.654202:0:8595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66900 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.654214:0:8595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8595:1873908077725440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787098125.654232:0:8595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098125.654240:0:8595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098125.654242:0:8595:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787098125.654247:0:8595:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7227639800 00000020:00000080:1.0:1787098125.654249:0:8595:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787098125.654336:0:8595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8595:1873908077725568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098125.654368:0:8595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.654385:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077725568 00000100:00100000:1.0:1787098125.654389:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077725568 00000100:00100000:1.0:1787098125.654408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787098125.654413:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8595:x1873908077725568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098125.654507:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:8595:x1873908077725568:12345-0@lo:502:llog_process_th.0 Request processed in 92us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.661242:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787098125.661814:0:8595:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66900 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.661846:0:8595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8595:1873908077725568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787098125.661889:0:8595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098125.661897:0:8595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098125.661899:0:8595:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787098125.661903:0:8595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787098125.662068:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787098125.662086:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787098125.662096:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098125.662108:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098125.662119:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787098125.662121:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d72079cb000 from 4 10000000:01000000:3.0:1787098125.662124:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787098125.662154:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098125.662162:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098125.662171:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098125.662190:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787098125.662247:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098125.662297:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203eaf240 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.663757:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077725696 00000100:00100000:1.0:1787098125.663767:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077725696 00000100:00100000:1.0:1787098125.663806:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787098125.663814:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077725696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098125.663829:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098125.663843:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144718 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.663865:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144718 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.663876:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144718 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.663885:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412e00, rc 0) 00000100:00100000:1.0:1787098125.663932:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077725696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.663939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787098125.663981:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098125.663995:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.664004:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098125.664068:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.664094:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.664118:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.664129:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077725824 00000100:00100000:1.0:1787098125.664132:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077725824 00000100:00100000:1.0:1787098125.664151:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787098125.664156:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077725824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.664393:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077725824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.664399:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787098125.664430:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.664456:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.664491:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.664503:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098125.664513:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077725952 00000100:00100000:1.0:1787098125.664516:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077725952 00000100:00100000:1.0:1787098125.664533:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787098125.664537:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077725952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098125.667866:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077725952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3315us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.667881:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787098125.668808:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077725952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098125.676467:0:8598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8598:1873908077726080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098125.676552:0:8598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098125.676632:0:8598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7208bc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098125.682445:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077726080 00000100:00100000:0.0:1787098125.682458:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077726080 00000100:00100000:0.0:1787098125.682788:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787098125.682798:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:8598:x1873908077726080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098125.683058:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:8598:x1873908077726080:12345-0@lo:502:llog_process_th.0 Request processed in 260us (6504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098125.683067:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787098125.683133:0:8598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8598:1873908077726080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787098125.683170:0:8598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787098125.683180:0:8598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098125.683183:0:8598:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787098125.683189:0:8598:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d72079cb000 00000020:00000080:0.0:1787098125.683191:0:8598:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787098125.685375:0:8598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8598:1873908077726208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098125.688300:0:8598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.688344:0:8598:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241ac2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787098125.688758:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077726208 00000100:00100000:0.0:1787098125.688768:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077726208 00000100:00100000:0.0:1787098125.688822:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787098125.688831:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:8598:x1873908077726208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098125.689052:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:8598:x1873908077726208:12345-0@lo:502:llog_process_th.0 Request processed in 221us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098125.689059:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787098125.689159:0:8598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:8598:1873908077726208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787098125.689197:0:8598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098125.689205:0:8598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098125.689207:0:8598:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787098125.689212:0:8598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787098125.689396:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787098125.689415:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787098125.689424:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098125.689436:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098125.711806:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098125.969438:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077726592:0@lo:400:kworker.0 00000100:00100000:2.0:1787098125.969501:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098125.969555:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787098125.969562:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077726464:0@lo:400:kworker.0 00000100:00100000:2.0:1787098125.969581:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098125.969597:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077726976:0@lo:400:kworker.0 00000100:00100000:2.0:1787098125.969616:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098125.969646:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077726592 00000100:00100000:2.0:1787098125.969652:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077726592 00000100:00100000:2.0:1787098125.969695:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077726464 00000100:00100000:2.0:1787098125.969697:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077726464 00000100:00100000:2.0:1787098125.969713:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787098125.969737:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077726592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098125.969755:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787098125.969764:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077726464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098125.969785:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077726592:12345-0@lo:400:kworker.0 Request processed in 49us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098125.969792:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077726464:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098125.969798:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787098125.969887:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077726336:0@lo:400:kworker.0 00000100:00100000:1.0:1787098125.969917:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.969939:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077726848:0@lo:400:kworker.0 00000100:00100000:1.0:1787098125.969957:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.969967:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787098125.969972:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077726720:0@lo:400:kworker.0 00000100:00100000:1.0:1787098125.969987:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098125.970012:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077726336 00000100:00100000:1.0:1787098125.970016:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077726336 00000100:00100000:1.0:1787098125.970039:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787098125.970045:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077726336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098125.970072:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077726336:12345-0@lo:400:kworker.0 Request processed in 28us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.970078:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787098125.970103:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077726976 00000100:00100000:1.0:1787098125.970106:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077726976 00000100:00100000:1.0:1787098125.970143:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077726720 00000100:00100000:1.0:1787098125.970146:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077726720 00000100:00100000:1.0:1787098125.970166:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787098125.970173:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077726976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098125.970201:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077726976:12345-0@lo:400:kworker.0 Request processed in 29us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.970216:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787098125.970228:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787098125.970234:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077726720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098125.970272:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077726720:12345-0@lo:400:kworker.0 Request processed in 38us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098125.970298:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787098125.970455:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207df3b80 x1873908077726720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098125.970469:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077726720:0@lo:400:kworker.0 00000100:00100000:1.0:1787098125.970478:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077726336:0@lo:400:kworker.0 00000100:00100000:2.0:1787098125.970561:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077726848 00000100:00100000:2.0:1787098125.970565:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077726848 00000100:00100000:3.0:1787098125.971838:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787098125.973342:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787098125.973349:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787098125.973352:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098125.973909:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787098125.973926:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077726848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098125.974060:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077726848:12345-0@lo:400:kworker.0 Request processed in 142us (4101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098125.974067:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787098125.974115:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077726464:0@lo:400:kworker.0 00010000:00080000:2.0:1787098125.974143:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207df2d80 x1873908077726976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098125.974154:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077726976:0@lo:400:kworker.0 00000100:00100000:2.0:1787098125.974167:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077726592:0@lo:400:kworker.0 00000100:00100000:0.0:1787098125.977388:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077726848:0@lo:400:kworker.0 00000100:00100000:2.0:1787098126.481090:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077727104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098126.481178:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098126.481350:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077727104 00000100:00100000:3.0:1787098126.481358:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077727104 00000100:00100000:3.0:1787098126.481417:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787098126.481426:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077727104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787098126.481466:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098126.484500:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077727104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3063us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098126.484592:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787098126.484736:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525180 x1873908077727104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098126.484762:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077727104:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787098126.735578:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098127.760598:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098128.527892:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787098128.527914:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077727232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098128.527975:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098128.528073:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077727232 00000100:00100000:2.0:1787098128.528082:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077727232 00000100:00100000:2.0:1787098128.528160:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787098128.528170:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077727232:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787098128.528180:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787098128.528214:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098128.528305:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077727232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098128.528313:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787098128.528372:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207df2d80 x1873908077727232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098128.528388:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077727232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787098128.784882:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098128.917527:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098128.917570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098128.917603:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098128.917626:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098128.917658:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059872128 00000100:00100000:3.0:1787098128.917668:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059872128 00000100:00100000:3.0:1787098128.917744:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:3.0:1787098128.917754:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059872128:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098128.917860:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059872128:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098128.917868:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:3.0:1787098128.917895:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059872256 00000100:00100000:3.0:1787098128.917899:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059872256 00000100:00100000:3.0:1787098128.917922:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059872384 00000100:00100000:3.0:1787098128.917925:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059872384 00000100:00100000:3.0:1787098128.917946:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1787098128.917953:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059872256:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098128.917987:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059872256:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098128.917994:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1787098128.918006:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1787098128.918013:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059872384:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098128.918035:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059872384:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098128.918041:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00080000:3.0:1787098128.918056:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787098128.918061:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787098128.918063:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098128.918338:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059872000 00000100:00100000:1.0:1787098128.918343:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059872000 00000100:00100000:1.0:1787098128.918381:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:1.0:1787098128.918389:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2374:x1873908059872000:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098128.918423:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2374:x1873908059872000:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098128.918429:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 191 00000001:02000400:3.0:1787098129.270955:0:8819:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787098129.808922:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098130.831813:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098131.091555:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077727488:0@lo:400:kworker.0 00000100:00100000:1.0:1787098131.091627:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098131.091673:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077728000:0@lo:400:kworker.0 00000100:00100000:1.0:1787098131.091698:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098131.091729:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787098131.091736:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077727616:0@lo:400:kworker.0 00000100:00100000:1.0:1787098131.091761:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098131.091796:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077728000 00000100:00100000:1.0:1787098131.091803:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077728000 00000100:00100000:1.0:1787098131.091860:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787098131.091870:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077728000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098131.091921:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077728000:12345-0@lo:400:kworker.0 Request processed in 52us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098131.091928:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787098131.091953:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077727488 00000100:00100000:1.0:1787098131.091957:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077727488 00000100:00100000:1.0:1787098131.091978:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077727616 00000100:00100000:1.0:1787098131.091980:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077727616 00000100:00100000:1.0:1787098131.091997:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787098131.092004:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077727488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098131.092029:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077727488:12345-0@lo:400:kworker.0 Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098131.092035:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787098131.092045:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787098131.092050:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077727616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098131.092087:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077727616:12345-0@lo:400:kworker.0 Request processed in 37us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098131.092092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787098131.092108:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787098131.092112:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787098131.092136:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077727616:0@lo:400:kworker.0 00000100:00100000:1.0:1787098131.092147:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077727488:0@lo:400:kworker.0 00010000:00080000:1.0:1787098131.092170:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72065e7800 x1873908077728000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098131.092180:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077728000:0@lo:400:kworker.0 00000100:00100000:2.0:1787098131.092246:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077727360:0@lo:400:kworker.0 00000100:00100000:2.0:1787098131.092303:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098131.092326:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077727872:0@lo:400:kworker.0 00000100:00100000:2.0:1787098131.092346:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098131.092359:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787098131.092364:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077727744:0@lo:400:kworker.0 00000100:00100000:2.0:1787098131.092382:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098131.092404:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077727872 00000100:00100000:2.0:1787098131.092407:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077727872 00000100:00100000:2.0:1787098131.092432:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787098131.092439:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077727872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098131.092472:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077727872:12345-0@lo:400:kworker.0 Request processed in 33us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098131.092478:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787098131.092495:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077727744 00000100:00100000:2.0:1787098131.092499:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077727744 00000100:00100000:2.0:1787098131.092521:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787098131.092528:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077727744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098131.092555:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077727744:12345-0@lo:400:kworker.0 Request processed in 28us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098131.092561:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787098131.092583:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72065e7100 x1873908077727744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098131.092603:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077727744:0@lo:400:kworker.0 00000100:00100000:2.0:1787098131.092612:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077727872:0@lo:400:kworker.0 00000100:00100000:1.0:1787098131.092774:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077727360 00000100:00100000:1.0:1787098131.092779:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077727360 00000100:00100000:1.0:1787098131.092838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787098131.092845:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077727360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098131.092888:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077727360:12345-0@lo:400:kworker.0 Request processed in 44us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098131.092894:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787098131.092950:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077727360:0@lo:400:kworker.0 00000100:00080000:1.0:1787098131.094233:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098131.094241:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098131.601552:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077728128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787098131.601624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098131.601702:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077728128 00000100:00100000:0.0:1787098131.601710:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077728128 00000100:00100000:0.0:1787098131.601761:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787098131.601770:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077728128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098131.601809:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098131.601851:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077728128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098131.601880:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787098131.601921:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525180 x1873908077728128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098131.601939:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077728128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787098131.860529:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098132.879421:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098133.653407:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077728256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098133.653499:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098133.653578:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077728256 00000100:00100000:1.0:1787098133.653585:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077728256 00000100:00100000:1.0:1787098133.653647:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787098133.653665:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077728256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787098133.653713:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098133.653761:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077728256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098133.653769:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787098133.653793:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787098133.653822:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525180 x1873908077728256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098133.653841:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077728256:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787098133.664706:0:9063:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing yml_node 00010000:00010000:1.0:1787098133.904450:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098134.049557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098134.049602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098134.049687:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059872768 00000100:00100000:0.0:1787098134.049698:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059872768 00000100:00100000:0.0:1787098134.049765:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059872896 00000100:00100000:0.0:1787098134.049769:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059872896 00000100:00100000:0.0:1787098134.049796:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1787098134.049807:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2372:x1873908059872768:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:0.0:1787098134.049845:0:6860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b014465b 00000100:00080000:0.0:1787098134.049856:0:6860:0:(import.c:65:import_set_state_nolock()) ffff8d7241aaa800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787098134.049894:0:6860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787098134.050264:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+2:2372:x1873908059872768:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 458us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098134.050273:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00080000:3.0:1787098134.050454:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787098134.050458:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098134.050582:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1787098134.050595:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2372:x1873908059872896:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:1.0:1787098134.050616:0:6702:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144662 00000100:00080000:1.0:1787098134.050624:0:6702:0:(import.c:65:import_set_state_nolock()) ffff8d7241aa8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787098134.050651:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787098134.050872:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+2:2372:x1873908059872896:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 280us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098134.050880:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00010000:00010000:1.0:1787098134.050902:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098134.050939:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098134.061112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098134.061167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098134.061211:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059872640 00000100:00100000:1.0:1787098134.061222:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059872640 00000100:00100000:1.0:1787098134.061320:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1787098134.061333:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059872640:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098134.061422:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059872640:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098134.061430:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00080000:1.0:1787098134.061457:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098134.061745:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059872512 00000100:00100000:2.0:1787098134.061750:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059872512 00000100:00100000:2.0:1787098134.061790:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:2.0:1787098134.061798:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2374:x1873908059872512:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098134.061836:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2374:x1873908059872512:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098134.061843:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 193 00010000:00010000:1.0:1787098134.927977:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098135.952420:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098136.207775:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077728512:0@lo:400:kworker.0 00000100:00100000:0.0:1787098136.207878:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098136.207965:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077729024:0@lo:400:kworker.0 00000100:00100000:0.0:1787098136.207997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098136.208037:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098136.208039:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077728768:0@lo:400:kworker.0 00000100:00100000:0.0:1787098136.208044:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077728640:0@lo:400:kworker.0 00000100:00100000:0.0:1787098136.208091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098136.208109:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098136.208143:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077728512 00000100:00100000:3.0:1787098136.208148:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787098136.208155:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077728384:0@lo:400:kworker.0 00000100:00100000:3.0:1787098136.208187:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098136.208213:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077728896:0@lo:400:kworker.0 00000100:00100000:3.0:1787098136.208236:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098136.208267:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077728640 00000100:00100000:3.0:1787098136.208273:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077728384 00000100:00100000:1.0:1787098136.208296:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077728640 00000100:00100000:3.0:1787098136.208300:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077728384 00000100:00100000:3.0:1787098136.208354:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787098136.208357:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077728896 00000100:00100000:1.0:1787098136.208362:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077728896 00000100:00100000:3.0:1787098136.208367:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077728384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098136.208387:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787098136.208397:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077728640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098136.208433:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077728384:12345-0@lo:400:kworker.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098136.208457:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077728640:12345-0@lo:400:kworker.0 Request processed in 61us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098136.208466:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787098136.208486:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787098136.208493:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077728896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098136.208524:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077728896:12345-0@lo:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098136.208530:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787098136.208551:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077729024 00000100:00100000:1.0:1787098136.208555:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077729024 00000100:00100000:3.0:1787098136.208581:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787098136.208583:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077728768 00000100:00100000:1.0:1787098136.208587:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077728768 00000100:00100000:3.0:1787098136.208696:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077728384:0@lo:400:kworker.0 00000100:00100000:0.0:1787098136.208702:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077728512 00000100:00100000:3.0:1787098136.208713:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077728896:0@lo:400:kworker.0 00000100:00100000:0.0:1787098136.208746:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787098136.208755:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077728512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098136.208782:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787098136.208796:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077728512:12345-0@lo:400:kworker.0 Request processed in 40us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098136.208797:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077729024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098136.208810:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787098136.208844:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077728640:0@lo:400:kworker.0 00000100:00100000:3.0:1787098136.208850:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077729024:12345-0@lo:400:kworker.0 Request processed in 58us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098136.208859:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787098136.208863:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077728512:0@lo:400:kworker.0 00010000:00080000:0.0:1787098136.208881:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1dc00 x1873908077729024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098136.208893:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077729024:0@lo:400:kworker.0 00000100:00080000:0.0:1787098136.208925:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787098136.208931:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098136.209017:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787098136.209026:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077728768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098136.209085:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077728768:12345-0@lo:400:kworker.0 Request processed in 60us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098136.209099:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787098136.209687:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787098136.212087:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72065e4700 x1873908077728768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098136.212111:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077728768:0@lo:400:kworker.0 00000100:00100000:1.0:1787098136.720107:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787098136.720146:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077729152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098136.720255:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098136.720504:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077729152 00000100:00100000:0.0:1787098136.720516:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077729152 00000100:00100000:0.0:1787098136.720591:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787098136.720603:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077729152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098136.720665:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098136.720735:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077729152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098136.720748:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787098136.721104:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525500 x1873908077729152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098136.721128:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077729152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787098136.975399:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787098137.318343:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:3.0:1787098137.318367:0:6727:0:(genops.c:906:class_export_put()) final put ffff8d7241aaf000/530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:2.0:1787098137.318587:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7241aaf000/530d6019-f48b-45e0-97e8-95fbd128e52b for lustre-OST0000 00000020:00000080:2.0:1787098137.318659:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7241aaa800 for lustre-OST0000 00000001:02000400:1.0:1787098137.822063:0:9256:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.1 00010000:00010000:1.0:1787098138.003907:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787098138.348264:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:0.0:1787098138.348295:0:7660:0:(genops.c:906:class_export_put()) final put ffff8d7241aad800/530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:1.0:1787098138.348336:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7241aad800/530d6019-f48b-45e0-97e8-95fbd128e52b for lustre-OST0001 00000020:00000080:1.0:1787098138.350526:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7241aa8800 for lustre-OST0001 00000100:00100000:0.0:1787098138.768362:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787098138.768393:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077729280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098138.768501:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098138.768732:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077729280 00000100:00100000:3.0:1787098138.768743:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077729280 00000100:00100000:3.0:1787098138.768831:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787098138.768842:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077729280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787098138.768889:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098138.768950:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077729280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098138.768957:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787098138.769022:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7227525500 x1873908077729280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098138.769044:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077729280:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787098138.769101:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787098139.023574:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098139.158063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098139.158127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098139.158207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059873024 00000100:00100000:2.0:1787098139.158220:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059873024 00000100:00100000:3.0:1787098139.158242:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059873152 00000100:00100000:3.0:1787098139.158259:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059873152 00000100:00100000:2.0:1787098139.158385:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:3.0:1787098139.158408:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:2.0:1787098139.158410:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2374:x1873908059873024:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098139.158427:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059873152:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098139.158517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2374:x1873908059873024:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 118us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098139.158528:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:3.0:1787098139.158585:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059873152:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 161us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098139.158596:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00080000:3.0:1787098139.158632:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787098140.047910:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787098140.176845:0:9355:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.1 00010000:00010000:1.0:1787098141.082216:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098141.327758:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787098141.327907:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787098141.327928:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077729792:0@lo:400:kworker.0 00000100:00100000:3.0:1787098141.328012:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098141.328099:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077729792 00000100:00100000:3.0:1787098141.328106:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077729792 00000100:00100000:3.0:1787098141.328162:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787098141.328171:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077729792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098141.328246:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077729792:12345-0@lo:400:kworker.0 Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098141.328254:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787098141.328302:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787098141.328337:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1e300 x1873908077729792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098141.328352:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077729792:0@lo:400:kworker.0 00000100:00100000:0.0:1787098141.328583:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077729536:0@lo:400:kworker.0 00000100:00100000:0.0:1787098141.328619:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098141.328654:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098141.328660:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077729664:0@lo:400:kworker.0 00000100:00100000:0.0:1787098141.328697:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098141.328734:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077729536 00000100:00100000:0.0:1787098141.328739:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077729536 00000100:00100000:0.0:1787098141.328766:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077729664 00000100:00100000:0.0:1787098141.328770:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077729664 00000100:00100000:0.0:1787098141.328792:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787098141.328799:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077729536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098141.328839:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077729536:12345-0@lo:400:kworker.0 Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098141.328845:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787098141.328859:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787098141.328865:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077729664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098141.328891:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077729664:12345-0@lo:400:kworker.0 Request processed in 26us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098141.328896:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787098141.328921:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077729664:0@lo:400:kworker.0 00000100:00100000:0.0:1787098141.328931:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077729536:0@lo:400:kworker.0 00000100:00080000:3.0:1787098141.334690:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098141.334726:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077729408:0@lo:400:kworker.0 00000100:00100000:3.0:1787098141.334826:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098141.335102:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077729408 00000100:00100000:2.0:1787098141.335113:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077729408 00000100:00100000:2.0:1787098141.335196:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787098141.335205:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077729408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098141.335310:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077729408:12345-0@lo:400:kworker.0 Request processed in 106us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098141.335319:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787098141.335589:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077729408:0@lo:400:kworker.0 00000100:00100000:3.0:1787098141.336011:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077729920:0@lo:400:kworker.0 00000100:00100000:3.0:1787098141.336055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098141.336401:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077729920 00000100:00100000:2.0:1787098141.336407:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077729920 00000100:00100000:2.0:1787098141.336467:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787098141.336476:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077729920:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787098141.336542:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098141.339326:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787098141.339350:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077730048:0@lo:400:kworker.0 00000100:00100000:0.0:1787098141.339424:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098141.339570:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077730048 00000100:00100000:1.0:1787098141.339578:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077730048 00000100:00080000:0.0:1787098141.339664:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787098141.339695:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787098141.339705:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077730048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098141.339763:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077730048:12345-0@lo:400:kworker.0 Request processed in 60us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098141.339770:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787098141.339990:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1f800 x1873908077730048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098141.340005:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077730048:0@lo:400:kworker.0 00000100:00100000:2.0:1787098141.343073:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077729920:12345-0@lo:400:kworker.0 Request processed in 6586us (7005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098141.343089:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787098141.344628:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077729920:0@lo:400:kworker.0 00000100:00100000:3.0:1787098141.840303:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098141.840328:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077730176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098141.840401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098141.840578:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077730176 00000100:00100000:1.0:1787098141.840587:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077730176 00000100:00100000:1.0:1787098141.840641:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787098141.840663:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077730176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098141.840699:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098141.840756:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077730176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098141.840763:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787098141.840882:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1c380 x1873908077730176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098141.840900:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077730176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787098142.095518:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787098142.521237:0:9452:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.1 00010000:00010000:1.0:1787098143.119480:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098143.888304:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787098143.888328:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077730304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098143.888406:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098143.888440:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077730304 00000100:00100000:2.0:1787098143.888449:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077730304 00000100:00080000:0.0:1787098143.888471:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098143.888505:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787098143.888519:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077730304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787098143.888555:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098143.888600:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077730304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098143.888608:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787098143.888686:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7206dec000 x1873908077730304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098143.888707:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077730304:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787098143.932918:0:9500:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Aug 18 20:09:02 EDT 2026 00010000:00010000:3.0:1787098144.143927:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098144.276399:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098144.276446:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098144.276521:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059873280 00000100:00100000:1.0:1787098144.276531:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059873280 00000100:00100000:1.0:1787098144.276591:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:1.0:1787098144.276602:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2376:x1873908059873280:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098144.276679:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059873408 00000100:00100000:0.0:1787098144.276683:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059873408 00000100:00100000:1.0:1787098144.276691:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2376:x1873908059873280:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 90us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098144.276700:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:0.0:1787098144.276735:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1787098144.276744:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059873408:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:1.0:1787098144.276756:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098144.276779:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059873408:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 36us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098144.276786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00010000:00010000:0.0:1787098145.167908:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098146.191564:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098146.448227:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077730432:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.448333:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098146.448460:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077730944:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.448489:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098146.448520:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787098146.448526:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077730816:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.448552:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098146.448965:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077730560:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.448997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098146.449929:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077731072:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.449971:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098146.450002:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098146.450010:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077730688:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.450033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098146.457369:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077730432 00000100:00100000:0.0:1787098146.457397:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077730432 00000100:00100000:0.0:1787098146.457467:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787098146.457479:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077730432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.457595:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077730432:12345-0@lo:400:kworker.0 Request processed in 105us (9247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098146.457604:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787098146.457930:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077730944 00000100:00100000:1.0:1787098146.457936:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077730944 00000100:00100000:3.0:1787098146.458170:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077730560 00000100:00100000:3.0:1787098146.458175:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077730560 00000100:00100000:3.0:1787098146.458210:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077730688 00000100:00100000:3.0:1787098146.458214:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077730688 00000100:00100000:3.0:1787098146.458232:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787098146.458239:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077730944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098146.458304:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077730944:12345-0@lo:400:kworker.0 Request processed in 66us (9814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098146.458310:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787098146.458337:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787098146.458342:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077730560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098146.458391:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077730560:12345-0@lo:400:kworker.0 Request processed in 48us (9393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098146.458396:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787098146.458411:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787098146.458417:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077730688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098146.458444:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077730688:12345-0@lo:400:kworker.0 Request processed in 28us (8411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098146.458449:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787098146.458709:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077730816 00000100:00100000:0.0:1787098146.458714:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077730816 00000100:00100000:0.0:1787098146.458752:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077731072 00000100:00100000:0.0:1787098146.458756:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077731072 00000100:00100000:0.0:1787098146.458789:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787098146.458796:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077730816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.458846:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077730816:12345-0@lo:400:kworker.0 Request processed in 51us (10293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098146.458864:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787098146.458876:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787098146.458882:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077731072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.458910:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077731072:12345-0@lo:400:kworker.0 Request processed in 28us (8939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098146.458916:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787098146.459144:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7206def480 x1873908077730816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098146.459159:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077730816:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.459176:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077730432:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.459188:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077730944:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.459233:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077730688:0@lo:400:kworker.0 00000100:00100000:0.0:1787098146.459245:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077730560:0@lo:400:kworker.0 00010000:00080000:0.0:1787098146.459255:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7206dedf80 x1873908077731072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098146.459264:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077731072:0@lo:400:kworker.0 00000100:00080000:0.0:1787098146.459327:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787098146.459331:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787098146.459334:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098146.962006:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787098146.962047:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077731200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098146.962126:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098146.962396:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077731200 00000100:00100000:1.0:1787098146.962406:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077731200 00000100:00100000:1.0:1787098146.962463:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787098146.962472:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077731200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098146.962508:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098146.962570:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077731200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098146.962578:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787098146.962828:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1d180 x1873908077731200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098146.962858:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077731200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787098147.215508:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098148.240628:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098149.009130:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077731328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098149.009256:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098149.010689:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077731328 00000100:00100000:2.0:1787098149.010707:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077731328 00000100:00100000:2.0:1787098149.010824:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787098149.010839:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077731328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787098149.010891:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098149.011005:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077731328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (1748us total) trans 0 rc 0/0 00000100:00080000:1.0:1787098149.011012:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098149.011013:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787098149.011066:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207df2d80 x1873908077731328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098149.011091:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077731328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787098149.263569:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098149.398598:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098149.398689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098149.400070:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059873536 00000100:00100000:2.0:1787098149.400089:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059873536 00000100:00100000:2.0:1787098149.400177:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:2.0:1787098149.400191:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2376:x1873908059873536:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098149.400654:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2376:x1873908059873536:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 462us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098149.400665:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:1.0:1787098149.401382:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059873664 00000100:00100000:1.0:1787098149.401394:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059873664 00000100:00100000:1.0:1787098149.401481:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:1.0:1787098149.401492:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059873664:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098149.401593:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059873664:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 103us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098149.401601:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00080000:0.0:1787098149.401732:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787098150.287596:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098151.314848:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098151.572058:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077731840:0@lo:400:kworker.0 00000100:00100000:0.0:1787098151.572163:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098151.572247:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077731456:0@lo:400:kworker.0 00000100:00100000:0.0:1787098151.572273:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077731584:0@lo:400:kworker.0 00000100:00100000:1.0:1787098151.572366:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098151.572374:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077731840 00000100:00100000:3.0:1787098151.572384:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077731840 00000100:00100000:1.0:1787098151.572446:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077731968:0@lo:400:kworker.0 00000100:00100000:1.0:1787098151.572478:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098151.572504:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787098151.572517:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077731840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098151.572529:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077731456 00000100:00100000:1.0:1787098151.572535:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077731456 00000100:00100000:1.0:1787098151.572567:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787098151.572574:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077731456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098151.572583:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077731840:12345-0@lo:400:kworker.0 Request processed in 68us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098151.572591:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787098151.572642:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077731456:12345-0@lo:400:kworker.0 Request processed in 68us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098151.572650:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1787098151.574131:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098151.580916:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098151.581247:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077732096:0@lo:400:kworker.0 00000100:00100000:0.0:1787098151.581650:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098151.581711:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098151.581722:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077731712:0@lo:400:kworker.0 00000100:00100000:0.0:1787098151.581789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098151.581812:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077731968 00000100:00100000:1.0:1787098151.581826:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077731968 00000100:00100000:0.0:1787098151.581837:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077732096 00000100:00100000:0.0:1787098151.581847:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077732096 00000100:00100000:0.0:1787098151.581908:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787098151.581918:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077732096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098151.582148:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077732096:12345-0@lo:400:kworker.0 Request processed in 230us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098151.582157:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787098151.583555:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077731584 00000100:00100000:1.0:1787098151.583568:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077731584 00000100:00100000:0.0:1787098151.584832:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077731712 00000100:00100000:0.0:1787098151.584849:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077731712 00000100:00100000:0.0:1787098151.584910:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787098151.584921:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077731968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098151.585218:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077731968:12345-0@lo:400:kworker.0 Request processed in 296us (12737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098151.585233:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787098151.585258:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787098151.585266:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077731584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098151.586002:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077731584:12345-0@lo:400:kworker.0 Request processed in 735us (5096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098151.586011:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787098151.586036:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787098151.586045:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077731712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098151.586078:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077731712:12345-0@lo:400:kworker.0 Request processed in 34us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098151.586084:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787098151.586181:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077731712:0@lo:400:kworker.0 00000100:00100000:0.0:1787098151.586199:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077731584:0@lo:400:kworker.0 00010000:00080000:0.0:1787098151.586216:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7206dece00 x1873908077732096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098151.586227:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077732096:0@lo:400:kworker.0 00000100:00080000:1.0:1787098151.587116:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098151.587126:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098151.587164:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077731456:0@lo:400:kworker.0 00000100:00100000:1.0:1787098151.587199:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077731968:0@lo:400:kworker.0 00010000:00080000:2.0:1787098151.587904:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7206dec000 x1873908077731840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098151.587934:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077731840:0@lo:400:kworker.0 00000100:00100000:0.0:1787098152.079879:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098152.080947:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077732224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787098152.082398:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098152.084617:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077732224 00000100:00100000:2.0:1787098152.084647:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077732224 00000100:00100000:2.0:1787098152.084790:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787098152.084804:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077732224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787098152.084864:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098152.084994:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077732224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098152.085002:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787098152.085720:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1c700 x1873908077732224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098152.085759:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077732224:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787098152.335438:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098153.359494:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098154.127531:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787098154.127558:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077732352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098154.127645:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098154.127912:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077732352 00000100:00100000:0.0:1787098154.127924:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077732352 00000100:00100000:0.0:1787098154.127995:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787098154.128015:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077732352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098154.128050:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098154.128111:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077732352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098154.128118:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787098154.128166:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207df2d80 x1873908077732352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098154.128185:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077732352:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787098154.129365:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787098154.386812:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098154.533000:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098154.533078:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098154.537062:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059873792 00000100:00100000:0.0:1787098154.537083:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059873792 00000100:00100000:0.0:1787098154.537147:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:0.0:1787098154.537158:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2376:x1873908059873792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098154.537251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2376:x1873908059873792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 95us (4172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098154.537259:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:2.0:1787098154.540649:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059873920 00000100:00100000:2.0:1787098154.540668:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059873920 00000100:00100000:3.0:1787098154.540852:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:3.0:1787098154.540865:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2375:x1873908059873920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098154.540956:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2375:x1873908059873920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 93us (7965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098154.540964:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00080000:0.0:1787098154.543582:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787098155.410248:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098156.431832:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098156.687599:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077732864:0@lo:400:kworker.0 00000100:00100000:0.0:1787098156.687612:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077732480:0@lo:400:kworker.0 00000100:00100000:1.0:1787098156.687810:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077732608:0@lo:400:kworker.0 00000100:00100000:2.0:1787098156.687906:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077732736:0@lo:400:kworker.0 00000100:00100000:3.0:1787098156.689891:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098156.689993:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077732864 00000100:00100000:3.0:1787098156.690003:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077732864 00000100:00100000:0.0:1787098156.690038:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098156.690074:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787098156.690084:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077732992:0@lo:400:kworker.0 00000100:00100000:3.0:1787098156.690086:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077732864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098156.690123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098156.690158:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077732864:12345-0@lo:400:kworker.0 Request processed in 75us (273us total) trans 0 rc 0/0 00000100:00080000:0.0:1787098156.690158:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787098156.690171:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787098156.690175:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077732480 00000100:00100000:0.0:1787098156.690180:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077732480 00000100:00100000:0.0:1787098156.690210:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00010000:00080000:3.0:1787098156.690221:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1c380 x1873908077732864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098156.690221:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077732480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098156.690242:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077732864:0@lo:400:kworker.0 00000100:00100000:0.0:1787098156.690298:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077732480:12345-0@lo:400:kworker.0 Request processed in 63us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098156.690306:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787098156.690342:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077732992 00000100:00100000:0.0:1787098156.690345:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077732992 00000100:00100000:0.0:1787098156.690393:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787098156.690400:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077732992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098156.690432:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077732992:12345-0@lo:400:kworker.0 Request processed in 33us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098156.690438:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787098156.690457:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098156.690474:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077732480:0@lo:400:kworker.0 00000100:00100000:0.0:1787098156.690497:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077732992:0@lo:400:kworker.0 00000100:00100000:1.0:1787098156.693203:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098156.693264:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077733120:0@lo:400:kworker.0 00000100:00100000:1.0:1787098156.693319:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098156.693470:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077732608 00000100:00100000:3.0:1787098156.693478:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077732608 00000100:00100000:3.0:1787098156.693537:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787098156.693546:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077732608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098156.693604:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077732608:12345-0@lo:400:kworker.0 Request processed in 59us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098156.693612:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787098156.694333:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077733120 00000100:00100000:0.0:1787098156.694343:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077733120 00000100:00100000:0.0:1787098156.694400:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787098156.694410:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077733120:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787098156.694421:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787098156.694474:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077733120:12345-0@lo:400:kworker.0 Request processed in 66us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098156.694493:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787098156.696590:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077732608:0@lo:400:kworker.0 00010000:00080000:1.0:1787098156.696611:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1f800 x1873908077733120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098156.696622:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077733120:0@lo:400:kworker.0 00000100:00100000:2.0:1787098156.696947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098156.697128:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077732736 00000100:00100000:0.0:1787098156.697135:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077732736 00000100:00080000:3.0:1787098156.697206:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098156.697209:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787098156.697218:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077732736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098156.697311:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077732736:12345-0@lo:400:kworker.0 Request processed in 94us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098156.697318:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787098156.697852:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077732736:0@lo:400:kworker.0 00000100:00100000:2.0:1787098157.201580:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787098157.201608:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077733248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098157.201702:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098157.202019:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077733248 00000100:00100000:0.0:1787098157.202028:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077733248 00000100:00100000:0.0:1787098157.202088:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787098157.202098:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077733248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098157.202157:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098157.202223:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077733248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098157.202232:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787098157.202669:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1f800 x1873908077733248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098157.202688:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077733248:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787098157.455584:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098158.479481:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787098158.483018:0:10131:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:09:17 (1787098157) === 00000100:00100000:1.0:1787098158.986024:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098158.986123:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059874048 00000100:00100000:3.0:1787098158.986134:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059874048 00000100:00100000:3.0:1787098158.986196:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:3.0:1787098158.986208:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:8165:x1873908059874048:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787098158.986234:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098158.986256:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c7800/0xb1d871f9b0144726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e52873bc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098158.986332:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c7800/0xb1d871f9b0144726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873bc expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098158.986345:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c7800/0xb1d871f9b0144726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873bc expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098158.986356:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7800, rc 0) 00000100:00100000:3.0:1787098158.986421:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8165:x1873908059874048:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 215us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098158.986428:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:3.0:1787098158.998745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098158.998908:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059874176 00000100:00100000:0.0:1787098158.998919:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059874176 00000100:00100000:0.0:1787098158.998981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:0.0:1787098158.998992:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8165:x1873908059874176:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787098158.999340:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8165:x1873908059874176:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 349us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098158.999349:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:0.0:1787098159.001678:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098159.001860:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059874304 00000100:00100000:3.0:1787098159.001869:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059874304 00000100:00100000:3.0:1787098159.001923:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:3.0:1787098159.001931:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8165:x1873908059874304:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787098159.002475:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8165:x1873908059874304:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 542us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098159.002484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:1.0:1787098159.020028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098159.020116:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059874432 00000100:00100000:2.0:1787098159.020126:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059874432 00000100:00100000:2.0:1787098159.020178:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:2.0:1787098159.020188:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8169:x1873908059874432:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787098159.020530:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8169:x1873908059874432:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 342us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098159.020545:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:1.0:1787098159.038797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098159.038887:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059874560 00000100:00100000:3.0:1787098159.038898:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059874560 00000100:00100000:3.0:1787098159.038967:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:3.0:1787098159.038976:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8169:x1873908059874560:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787098159.039265:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8169:x1873908059874560:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 289us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098159.039308:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:3.0:1787098159.052638:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098159.056578:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059874688 00000100:00100000:0.0:1787098159.056593:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059874688 00000100:00100000:0.0:1787098159.056677:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:0.0:1787098159.056694:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:8165:x1873908059874688:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787098159.056822:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098159.056841:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208694000/0xb1d871f9b014472d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e52873e6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098159.056870:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208694000/0xb1d871f9b014472d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873e6 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098159.056882:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208694000/0xb1d871f9b014472d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873e6 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098159.056910:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694000, rc 0) 00000100:00100000:0.0:1787098159.056977:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:8165:x1873908059874688:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 285us (4353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098159.056984:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:1.0:1787098159.063713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098159.063821:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059874816 00000100:00100000:2.0:1787098159.063832:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059874816 00000100:00100000:2.0:1787098159.063889:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:2.0:1787098159.063898:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:8165:x1873908059874816:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787098159.063925:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787098159.063951:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787098159.063955:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787098159.063958:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787098159.063960:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787098159.066006:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:8165:x1873908059874816:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 2100us (2295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098159.066020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:0.0:1787098159.070876:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098159.070983:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059874944 00000100:00100000:2.0:1787098159.070994:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059874944 00000100:00100000:2.0:1787098159.071050:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:2.0:1787098159.071061:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:8165:x1873908059874944:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787098159.071077:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098159.071094:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e52873ed expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098159.071125:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ed expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098159.071138:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ed expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098159.071164:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030600, rc 0) 00000100:00100000:2.0:1787098159.071227:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:8165:x1873908059874944:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 168us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098159.071234:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:1.0:1787098159.074138:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098159.074236:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059875072 00000100:00100000:2.0:1787098159.074246:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059875072 00000100:00100000:0.0:1787098159.074582:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:0.0:1787098159.074595:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:8165:x1873908059875072:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787098159.075033:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:8165:x1873908059875072:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 438us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098159.075042:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:1.0:1787098159.081226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098159.081505:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059875200 00000100:00100000:3.0:1787098159.081515:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059875200 00000100:00100000:3.0:1787098159.081572:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:3.0:1787098159.081583:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:8165:x1873908059875200:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787098159.082064:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:8165:x1873908059875200:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 480us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098159.082073:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:2.0:1787098159.090156:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098159.090506:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059875328 00000100:00100000:0.0:1787098159.090517:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059875328 00000100:00100000:0.0:1787098159.090620:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:0.0:1787098159.090631:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:8174:x1873908059875328:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098159.090889:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:8174:x1873908059875328:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 258us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098159.090896:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:1.0:1787098159.096703:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098159.096793:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059875456 00000100:00100000:3.0:1787098159.096804:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059875456 00000100:00100000:3.0:1787098159.096860:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:3.0:1787098159.096870:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:8174:x1873908059875456:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787098159.097116:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:8174:x1873908059875456:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 246us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098159.097124:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:1.0:1787098159.099552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098159.099587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098159.100224:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059875712 00000100:00100000:2.0:1787098159.100235:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059875712 00000100:00100000:2.0:1787098159.100353:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059875584 00000100:00100000:2.0:1787098159.100357:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059875584 00000100:00100000:2.0:1787098159.100393:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1787098159.100405:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059875712:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098159.100476:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059875712:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 74us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098159.100483:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1787098159.100500:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1787098159.100505:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2372:x1873908059875584:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787098159.100529:0:5843:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 1944369d-673b-48ef-ae48-bb74d2b5ab81@192.168.204.51@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1787098159.100563:0:5843:0:(genops.c:1406:class_connect()) connect: client 1944369d-673b-48ef-ae48-bb74d2b5ab81, cookie 0xb1d871f9b014473b 00000004:00100000:2.0:1787098159.100591:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787098159.101242:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d723b44b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787098159.101316:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2372:x1873908059875584:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 808us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098159.101324:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00080000:0.0:1787098159.103992:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098159.105922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098159.107343:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098159.107924:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059875840 00000100:00100000:0.0:1787098159.107935:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059875840 00000100:00100000:0.0:1787098159.108168:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059875968 00000100:00100000:0.0:1787098159.108172:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059875968 00000100:00100000:0.0:1787098159.108197:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1787098159.108207:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+7:0:x1873908059875840:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787098159.108305:0:6853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787098159.108413:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+7:0:x1873908059875840:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 207us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098159.108421:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1787098159.108441:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1787098159.108448:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:8165:x1873908059875968:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787098159.108460:0:6853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787098159.108483:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:8165:x1873908059875968:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 35us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098159.108489:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00080000:3.0:1787098159.108677:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098159.115059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098159.115494:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059876096 00000100:00100000:0.0:1787098159.115505:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059876096 00000100:00100000:0.0:1787098159.115571:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1787098159.115581:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:8165:x1873908059876096:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787098159.116066:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:8165:x1873908059876096:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 484us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098159.116824:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1787098159.125692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098159.126177:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098159.126322:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059876224 00000100:00100000:0.0:1787098159.126334:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059876224 00000100:00100000:0.0:1787098159.126455:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059876352 00000100:00100000:0.0:1787098159.126459:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059876352 00000100:00100000:0.0:1787098159.126486:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1787098159.126493:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2372:x1873908059876224:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787098159.126522:0:6702:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 1944369d-673b-48ef-ae48-bb74d2b5ab81@192.168.204.51@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:0.0:1787098159.126554:0:6702:0:(genops.c:1406:class_connect()) connect: client 1944369d-673b-48ef-ae48-bb74d2b5ab81, cookie 0xb1d871f9b0144742 00002000:00100000:0.0:1787098159.126576:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1944369d-673b-48ef-ae48-bb74d2b5ab81/ffff8d723b571800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787098159.126599:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787098159.127201:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1787098159.127210:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2372:x1873908059876352:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787098159.127232:0:6860:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 1944369d-673b-48ef-ae48-bb74d2b5ab81@192.168.204.51@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1787098159.127259:0:6860:0:(genops.c:1406:class_connect()) connect: client 1944369d-673b-48ef-ae48-bb74d2b5ab81, cookie 0xb1d871f9b0144749 00002000:00100000:2.0:1787098159.127269:0:6860:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1944369d-673b-48ef-ae48-bb74d2b5ab81/ffff8d723b44f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787098159.127321:0:6860:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787098159.127644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00002000:00080000:0.0:1787098159.129260:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787098159.129316:0:6702:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098159.129411:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2372:x1873908059876224:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 2916us (4705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098159.129423:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1787098159.129555:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059876480 00000100:00100000:3.0:1787098159.129563:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059876480 00000100:00100000:3.0:1787098159.129624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1787098159.129635:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:8165:x1873908059876480:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787098159.129861:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787098159.129988:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:8165:x1873908059876480:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 354us (2343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098159.129994:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00080000:2.0:1787098159.130107:0:6860:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787098159.130128:0:6860:0:(import.c:65:import_set_state_nolock()) ffff8d723b44a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787098159.130157:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2372:x1873908059876352:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 2947us (3982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098159.130164:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1787098159.247583:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077733376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098159.247665:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098159.247812:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077733376 00000100:00100000:0.0:1787098159.247821:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077733376 00000100:00100000:0.0:1787098159.247891:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787098159.247901:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077733376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098159.247924:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787098159.248031:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098159.250035:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077733376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2127us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098159.250049:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787098159.250845:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7207df3b80 x1873908077733376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098159.250870:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077733376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787098159.504619:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098160.536524:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098161.553380:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098161.807789:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077733888:0@lo:400:kworker.0 00000100:00100000:2.0:1787098161.807854:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077733632:0@lo:400:kworker.0 00000100:00100000:3.0:1787098161.807863:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098161.807887:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098161.807941:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077733888 00000100:00100000:1.0:1787098161.807949:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077733888 00000100:00100000:1.0:1787098161.808016:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787098161.808026:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077733888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098161.808086:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077733504:0@lo:400:kworker.0 00000100:00100000:3.0:1787098161.808118:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077733760:0@lo:400:kworker.0 00000100:00100000:2.0:1787098161.808843:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077734144:0@lo:400:kworker.0 00000100:00100000:2.0:1787098161.808960:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098161.809014:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077734144 00000100:00100000:2.0:1787098161.809019:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077734144 00000100:00100000:2.0:1787098161.809122:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787098161.809131:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077734144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098161.809226:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077734144:12345-0@lo:400:kworker.0 Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098161.809233:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787098161.809273:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b0e1180 x1873908077734144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098161.809305:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077734144:0@lo:400:kworker.0 00000100:00100000:1.0:1787098161.810952:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077733888:12345-0@lo:400:kworker.0 Request processed in 2919us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098161.810965:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787098161.811017:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077733632 00000100:00100000:1.0:1787098161.811025:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077733632 00000100:00100000:1.0:1787098161.811071:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787098161.811080:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077733632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098161.811138:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077733632:12345-0@lo:400:kworker.0 Request processed in 60us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098161.811157:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787098161.811175:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098161.811181:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098161.811218:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077733632:0@lo:400:kworker.0 00010000:00080000:2.0:1787098161.811832:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b0e3800 x1873908077733888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098161.811845:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077733888:0@lo:400:kworker.0 00000100:00100000:2.0:1787098161.814461:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098161.814518:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077733760 00000100:00100000:1.0:1787098161.814528:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077733760 00000100:00080000:2.0:1787098161.814594:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098161.814612:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787098161.814623:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098161.814699:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077733760:12345-0@lo:400:kworker.0 Request processed in 78us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098161.814706:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787098161.814754:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077733760:0@lo:400:kworker.0 00000100:00100000:0.0:1787098161.817034:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098161.817105:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077734016:0@lo:400:kworker.0 00000100:00100000:2.0:1787098161.817132:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077733504 00000100:00100000:2.0:1787098161.817141:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077733504 00000100:00100000:0.0:1787098161.817150:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098161.817189:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787098161.817208:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077733504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098161.817227:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077734016 00000100:00100000:1.0:1787098161.817234:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077734016 00000100:00100000:2.0:1787098161.817268:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077733504:12345-0@lo:400:kworker.0 Request processed in 61us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098161.817301:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787098161.817314:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787098161.817324:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077733504:0@lo:400:kworker.0 00000100:00100000:1.0:1787098161.817327:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077734016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098161.817399:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077734016:12345-0@lo:400:kworker.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098161.817406:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787098161.817429:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098161.817565:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077734016:0@lo:400:kworker.0 00000100:00100000:3.0:1787098162.320355:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077734272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098162.320435:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098162.320651:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077734272 00000100:00100000:1.0:1787098162.320662:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077734272 00000100:00100000:1.0:1787098162.320723:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787098162.320733:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077734272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098162.320770:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098162.322443:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077734272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1703us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098162.322476:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787098162.324042:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b0e0e00 x1873908077734272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098162.324072:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077734272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787098162.575763:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787098162.906427:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1944369d-673b-48ef-ae48-bb74d2b5ab81 00000001:00100000:2.0:1787098163.397996:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1944369d-673b-48ef-ae48-bb74d2b5ab81 00010000:00010000:3.0:1787098163.601134:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787098163.931047:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1944369d-673b-48ef-ae48-bb74d2b5ab81 00000001:02000400:3.0:1787098163.972503:0:10329:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787098164.246562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098164.246625:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098164.246650:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059876608 00000100:00100000:0.0:1787098164.246667:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059876608 00000100:00100000:3.0:1787098164.246668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098164.246698:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098164.246767:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:3.0:1787098164.246790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098164.246792:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059876608:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098164.246846:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059877120 00000100:00100000:3.0:1787098164.246857:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059877120 00000100:00100000:0.0:1787098164.246904:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059876608:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 125us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098164.246917:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:3.0:1787098164.246936:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059876992 00000100:00100000:3.0:1787098164.246942:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059876992 00000100:00100000:3.0:1787098164.246985:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1787098164.246999:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059877120:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098164.247072:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059877120:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098164.247081:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1787098164.247108:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:3.0:1787098164.247121:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059876992:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098164.247162:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059876992:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 47us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098164.247169:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:2.0:1787098164.247271:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059876864 00000100:00100000:2.0:1787098164.247310:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059876864 00000100:00100000:2.0:1787098164.247350:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059876736 00000100:00100000:2.0:1787098164.247354:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059876736 00000100:00100000:2.0:1787098164.247382:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:2.0:1787098164.247390:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059876864:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098164.247517:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059876864:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 127us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098164.247526:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:2.0:1787098164.247546:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:2.0:1787098164.247554:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2375:x1873908059876736:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098164.247597:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2375:x1873908059876736:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098164.247605:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00080000:1.0:1787098164.247761:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787098164.247769:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098164.247774:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787098164.367803:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077734400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098164.367876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098164.368666:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077734400 00000100:00100000:1.0:1787098164.368677:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077734400 00000100:00100000:1.0:1787098164.368766:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787098164.368776:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077734400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787098164.368811:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098164.368880:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077734400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098164.368887:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787098164.368969:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787098164.369043:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f93b80 x1873908077734400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098164.369064:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077734400:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787098164.623927:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098165.649203:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098166.671415:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098166.931468:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077734528:0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.931539:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098166.931599:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077735040:0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.931626:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098166.931658:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787098166.931664:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077734912:0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.931687:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098166.931719:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077734656:0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.931744:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098166.931763:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077735168:0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.931783:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098166.931802:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787098166.931808:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077734784:0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.931852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098166.931889:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077735040 00000100:00100000:1.0:1787098166.931896:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077735040 00000100:00100000:1.0:1787098166.931953:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077734656 00000100:00100000:1.0:1787098166.931957:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077734656 00000100:00100000:1.0:1787098166.931971:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077734784 00000100:00100000:1.0:1787098166.931973:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077734784 00000100:00100000:1.0:1787098166.931993:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787098166.932003:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077735040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.932054:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077735040:12345-0@lo:400:kworker.0 Request processed in 54us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098166.932060:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787098166.932365:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787098166.932373:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077734656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.932409:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077734656:12345-0@lo:400:kworker.0 Request processed in 37us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098166.932414:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787098166.932426:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787098166.932432:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077734784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.932468:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077734784:12345-0@lo:400:kworker.0 Request processed in 36us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098166.932473:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787098166.932493:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077734912 00000100:00100000:1.0:1787098166.932496:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077734912 00000100:00100000:1.0:1787098166.932521:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077735168 00000100:00100000:1.0:1787098166.932524:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077735168 00000100:00100000:1.0:1787098166.932544:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787098166.932550:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077734912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.932590:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077734912:12345-0@lo:400:kworker.0 Request processed in 40us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098166.932596:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787098166.932607:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787098166.932613:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077735168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.932636:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077735168:12345-0@lo:400:kworker.0 Request processed in 24us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098166.932642:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787098166.932665:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098166.932669:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098166.932671:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787098166.932700:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b0e1500 x1873908077734912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098166.932714:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077734912:0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.932725:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077735040:0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.932755:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077734784:0@lo:400:kworker.0 00000100:00100000:1.0:1787098166.932764:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077734656:0@lo:400:kworker.0 00010000:00080000:1.0:1787098166.932773:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b0e0000 x1873908077735168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098166.932781:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077735168:0@lo:400:kworker.0 00000100:00100000:2.0:1787098166.933090:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077734528 00000100:00100000:2.0:1787098166.933095:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077734528 00000100:00100000:2.0:1787098166.933125:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787098166.933132:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077734528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098166.933171:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077734528:12345-0@lo:400:kworker.0 Request processed in 40us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098166.933177:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787098166.933530:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077734528:0@lo:400:kworker.0 00000100:00100000:1.0:1787098167.439838:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787098167.439866:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077735296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098167.440171:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098167.440260:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077735296 00000100:00100000:1.0:1787098167.440269:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077735296 00000100:00100000:1.0:1787098167.440536:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787098167.440546:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077735296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098167.440584:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098167.440633:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077735296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098167.440641:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787098167.440687:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b0e2680 x1873908077735296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098167.440704:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077735296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787098167.696330:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098168.720179:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098169.364003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098169.364059:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098169.364148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098169.364182:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059877760 00000100:00100000:3.0:1787098169.364192:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059877760 00000100:00100000:3.0:1787098169.364259:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1787098169.364269:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059877760:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098169.364382:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059877760:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 115us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098169.364390:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00080000:3.0:1787098169.364422:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787098169.365166:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098169.365194:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098169.365216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059877504 00000100:00100000:3.0:1787098169.365222:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059877504 00000100:00100000:3.0:1787098169.365261:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059877376 00000100:00100000:3.0:1787098169.365264:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059877376 00000100:00100000:3.0:1787098169.365503:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1787098169.365902:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059877504:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098169.365974:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059877504:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 462us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098169.365983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1787098169.366001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:3.0:1787098169.366009:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059877376:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098169.366036:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059877376:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098169.366043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:0.0:1787098169.366520:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059877248 00000100:00100000:0.0:1787098169.366527:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059877248 00000100:00100000:0.0:1787098169.366568:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:0.0:1787098169.366575:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059877248:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098169.366608:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059877248:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098169.366614:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:3.0:1787098169.366750:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059877632 00000100:00100000:3.0:1787098169.366755:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059877632 00000100:00100000:3.0:1787098169.366793:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:3.0:1787098169.366800:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059877632:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098169.366829:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059877632:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098169.366857:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00080000:3.0:1787098169.366881:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787098169.366885:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098169.488375:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787098169.488411:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077735424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098169.488482:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098169.488802:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077735424 00000100:00100000:2.0:1787098169.488811:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077735424 00000100:00100000:2.0:1787098169.488977:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787098169.488986:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077735424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787098169.489020:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098169.489064:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077735424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098169.489071:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787098169.490780:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787098169.490851:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f90a80 x1873908077735424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098169.490880:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077735424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787098169.746635:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098170.767512:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098171.795348:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098172.047694:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077735552:0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.047782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098172.047831:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077736064:0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.047859:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098172.047888:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787098172.047893:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077735936:0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.047919:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098172.047946:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077735680:0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.047967:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098172.047983:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b1ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077736192:0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048004:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098172.048019:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098172.048024:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077735808:0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048043:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098172.048075:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077736064 00000100:00100000:3.0:1787098172.048082:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077736064 00000100:00100000:3.0:1787098172.048129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077735680 00000100:00100000:3.0:1787098172.048133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077735680 00000100:00100000:3.0:1787098172.048144:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077735808 00000100:00100000:3.0:1787098172.048146:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077735808 00000100:00100000:3.0:1787098172.048161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787098172.048169:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077736064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048245:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077736064:12345-0@lo:400:kworker.0 Request processed in 76us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098172.048253:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787098172.048271:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787098172.048295:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077735680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048327:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077735680:12345-0@lo:400:kworker.0 Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098172.048333:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787098172.048346:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787098172.048366:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077735808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048393:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077735808:12345-0@lo:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098172.048399:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787098172.048417:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077735936 00000100:00100000:3.0:1787098172.048420:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077735936 00000100:00100000:3.0:1787098172.048444:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077736192 00000100:00100000:3.0:1787098172.048446:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077736192 00000100:00100000:3.0:1787098172.048466:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787098172.048472:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077735936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048502:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077735936:12345-0@lo:400:kworker.0 Request processed in 29us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098172.048509:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787098172.048519:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787098172.048524:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d724118d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077736192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048549:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d724118d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077736192:12345-0@lo:400:kworker.0 Request processed in 24us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098172.048563:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787098172.048702:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077735552 00000100:00100000:2.0:1787098172.048706:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077735552 00000100:00080000:3.0:1787098172.048713:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787098172.048718:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787098172.048720:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098172.048733:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787098172.048740:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077735552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098172.048773:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077735552:12345-0@lo:400:kworker.0 Request processed in 34us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098172.048787:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787098172.048827:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b1b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077735808:0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048839:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077735680:0@lo:400:kworker.0 00010000:00080000:3.0:1787098172.048850:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b1ba680 x1873908077736192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098172.048860:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b1ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077736192:0@lo:400:kworker.0 00010000:00080000:3.0:1787098172.048888:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b1b9180 x1873908077735936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098172.048896:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077735936:0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048904:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077735552:0@lo:400:kworker.0 00000100:00100000:3.0:1787098172.048913:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077736064:0@lo:400:kworker.0 00000100:00100000:2.0:1787098172.563184:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787098172.563206:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077736320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098172.563305:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098172.563923:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077736320 00000100:00100000:1.0:1787098172.563933:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077736320 00000100:00100000:1.0:1787098172.563989:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787098172.563998:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077736320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098172.564034:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098172.564087:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077736320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098172.564106:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787098172.564147:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b0e0700 x1873908077736320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098172.564164:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077736320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787098172.816408:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098173.840859:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098174.490706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098174.490798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098174.490834:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098174.490856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098174.490899:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059878272 00000100:00100000:0.0:1787098174.490908:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059878272 00000100:00100000:0.0:1787098174.490970:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1787098174.490981:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059878272:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098174.491063:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059878272:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 83us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098174.491071:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00080000:0.0:1787098174.491093:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098174.497504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098174.497556:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059878400 00000100:00100000:1.0:1787098174.497565:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059878400 00000100:00100000:1.0:1787098174.497626:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1787098174.497637:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059878400:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098174.497708:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059878400:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098174.497716:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00080000:1.0:1787098174.497833:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787098174.502272:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059878016 00000100:00100000:2.0:1787098174.502313:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059878016 00000100:00100000:2.0:1787098174.502397:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059878144 00000100:00100000:2.0:1787098174.502402:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059878144 00000100:00100000:2.0:1787098174.502433:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:2.0:1787098174.502443:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059878016:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098174.502527:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059878016:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 84us (11831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098174.502708:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:2.0:1787098174.502728:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:2.0:1787098174.502736:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059878144:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098174.502767:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059878144:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 32us (11910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098174.502774:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:2.0:1787098174.502800:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059877888 00000100:00100000:2.0:1787098174.502804:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059877888 00000100:00100000:2.0:1787098174.502829:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:2.0:1787098174.502835:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059877888:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098174.502859:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059877888:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (12025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098174.502865:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00080000:1.0:1787098174.503244:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098174.608635:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077736448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098174.608731:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098174.608808:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077736448 00000100:00100000:3.0:1787098174.608816:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077736448 00000100:00100000:3.0:1787098174.608868:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787098174.608877:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077736448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787098174.608910:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098174.608953:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077736448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098174.608969:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787098174.608989:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787098174.609018:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f92d80 x1873908077736448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098174.609047:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077736448:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787098174.863579:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098175.887388:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098176.912995:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098177.168054:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077736704:0@lo:400:kworker.0 00000100:00100000:0.0:1787098177.168198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098177.168271:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077737216:0@lo:400:kworker.0 00000100:00100000:0.0:1787098177.168498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098177.168531:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098177.168537:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077736832:0@lo:400:kworker.0 00000100:00100000:0.0:1787098177.168560:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098177.168594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077736704 00000100:00100000:0.0:1787098177.168600:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077736704 00000100:00100000:0.0:1787098177.168638:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077736832 00000100:00100000:1.0:1787098177.168777:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077737216 00000100:00100000:1.0:1787098177.168781:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077737216 00000100:00100000:1.0:1787098177.168822:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787098177.168830:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077737216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098177.168893:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077737216:12345-0@lo:400:kworker.0 Request processed in 63us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098177.168901:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787098177.168922:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787098177.168950:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72416ff800 x1873908077737216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098177.168966:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077737216:0@lo:400:kworker.0 00000100:00100000:1.0:1787098177.169104:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787098177.169112:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077736704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098177.169144:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077736704:12345-0@lo:400:kworker.0 Request processed in 34us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098177.169150:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787098177.169176:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077736704:0@lo:400:kworker.0 00000100:00100000:2.0:1787098177.169236:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077736960:0@lo:400:kworker.0 00000100:00100000:0.0:1787098177.169237:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077736832 00000100:00100000:2.0:1787098177.169293:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098177.169295:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787098177.169302:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077736832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098177.169314:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787098177.169320:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077736576:0@lo:400:kworker.0 00000100:00100000:2.0:1787098177.169348:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098177.169371:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077737088:0@lo:400:kworker.0 00000100:00100000:2.0:1787098177.169391:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098177.169412:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077736576 00000100:00100000:2.0:1787098177.169416:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077736576 00000100:00100000:2.0:1787098177.169440:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787098177.169447:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077736576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098177.169480:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077736576:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098177.169486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787098177.169520:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077736576:0@lo:400:kworker.0 00000100:00100000:3.0:1787098177.169563:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077737088 00000100:00100000:3.0:1787098177.169567:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077737088 00000100:00100000:3.0:1787098177.169605:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787098177.169612:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077737088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098177.169737:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077737088:12345-0@lo:400:kworker.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098177.169744:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787098177.169876:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077737088:0@lo:400:kworker.0 00000100:00100000:0.0:1787098177.170794:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077736832:12345-0@lo:400:kworker.0 Request processed in 1488us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098177.170803:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787098177.170895:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077736960 00000100:00100000:1.0:1787098177.170901:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077736960 00000100:00100000:1.0:1787098177.170944:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787098177.170952:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077736960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098177.171005:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077736960:12345-0@lo:400:kworker.0 Request processed in 54us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098177.171011:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787098177.171042:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72416fe300 x1873908077736960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098177.171055:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077736960:0@lo:400:kworker.0 00000100:00080000:1.0:1787098177.171073:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098177.171089:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098177.172413:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077736832:0@lo:400:kworker.0 00000100:00100000:1.0:1787098177.681734:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787098177.681760:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077737344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098177.681831:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098177.681903:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077737344 00000100:00100000:1.0:1787098177.681911:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077737344 00000100:00100000:1.0:1787098177.681959:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787098177.681967:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077737344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098177.682005:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098177.682052:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077737344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098177.682059:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787098177.682101:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b0e1f80 x1873908077737344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098177.682119:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077737344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787098177.936616:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787098178.238446:0:11029:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787098178.959414:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098179.609344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098179.609440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098179.609581:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059878528 00000100:00100000:3.0:1787098179.609668:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059878528 00000100:00100000:0.0:1787098179.609704:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059878784 00000100:00100000:0.0:1787098179.609710:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059878784 00000100:00100000:0.0:1787098179.609779:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:0.0:1787098179.609791:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059878784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098179.609866:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059878784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 78us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098179.609874:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00080000:0.0:1787098179.609899:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098179.610046:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:3.0:1787098179.610055:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059878528:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098179.610098:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059878528:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098179.610107:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:1.0:1787098179.610347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098179.610374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098179.610399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098179.610422:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059878912 00000100:00100000:1.0:1787098179.610426:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059878912 00000100:00100000:1.0:1787098179.610458:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059879040 00000100:00100000:1.0:1787098179.611042:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059879040 00000100:00100000:1.0:1787098179.611086:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1787098179.611095:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2372:x1873908059878912:12345-192.168.204.51@tcp:9:kworker.0 00000100:00100000:0.0:1787098179.611417:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059878656 00000100:00100000:0.0:1787098179.611423:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059878656 00000100:00100000:0.0:1787098179.611461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:0.0:1787098179.611470:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059878656:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098179.611545:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059878656:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 75us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098179.611553:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00080000:0.0:1787098179.611577:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787098179.611581:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787098179.611583:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1787098179.611687:0:6702:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144742 00000100:00080000:1.0:1787098179.611698:0:6702:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787098179.612113:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000001:00000004:1.0:1787098179.612348:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787098179.612799:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2372:x1873908059879040:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1787098179.612824:0:6701:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144749 00000100:00080000:3.0:1787098179.612843:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8d723b44a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787098179.612870:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787098179.613899:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+2:2372:x1873908059878912:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 2800us (3517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098179.613911:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00010000:00010000:0.0:1787098179.614494:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098179.615074:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098179.615580:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+2:2372:x1873908059879040:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 3448us (5170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098179.615664:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1787098179.727836:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077737472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098179.727905:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098179.728123:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077737472 00000100:00100000:2.0:1787098179.728132:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077737472 00000100:00080000:0.0:1787098179.728256:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098179.728359:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787098179.728371:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077737472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787098179.728406:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098179.728473:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077737472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098179.728482:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787098179.728670:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f92d80 x1873908077737472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098179.728691:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077737472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787098179.983425:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098181.012986:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787098181.059358:0:11176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1450f460 20000000:00000080:0.0:1787098181.059378:0:11176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d7203e1b000 uarg=0000000000000000 20000000:01000000:0.0:1787098181.059416:0:11176:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787098181.059422:0:11176:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787098181.059426:0:11176:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787098181.060794:0:11177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787098181.061016:0:11176:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787098181.075492:0:11176:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787098181.075527:0:11176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075552:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873b5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075562:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01446fc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075569:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014470a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075576:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144718 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075604:0:11176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ed expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075610:0:11176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075652:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ed expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075667:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ed expref: 12 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098181.075682:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077737600:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098181.075797:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144718 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075806:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144718 expref: 18 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098181.075815:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077737728:0@lo:104: 00000100:00100000:0.0:1787098181.075855:0:11176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787098181.075896:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b014470a expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098181.075905:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b014470a expref: 18 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098181.075916:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077737856:0@lo:104: 00000100:00100000:1.0:1787098181.076602:0:11176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787098181.076650:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01446fc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.076662:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01446fc expref: 18 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.076673:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077737984:0@lo:104: 00000100:00100000:1.0:1787098181.076821:0:11176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787098181.076855:0:11176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873b5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.076865:0:11176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873b5 expref: 12 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.076875:0:11176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077738112:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098181.076943:0:11176:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a78e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787098181.077051:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077737728 00000100:00100000:2.0:1787098181.077059:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077737728 00000100:00100000:2.0:1787098181.077236:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077737856 00000100:00100000:2.0:1787098181.077240:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077737856 00000100:00100000:2.0:1787098181.077252:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077737984 00000100:00100000:2.0:1787098181.077255:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077737984 00000100:00100000:2.0:1787098181.077269:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787098181.077276:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:11176:x1873908077737728:12345-0@lo:104: 00010000:00010000:2.0:1787098181.077303:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077364:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787098181.077371:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:11176:x1873908077737728:12345-0@lo:104: Request processed in 95us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098181.077378:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787098181.077394:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787098181.077400:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:11176:x1873908077737856:12345-0@lo:104: 00010000:00010000:2.0:1787098181.077407:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077440:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787098181.077444:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:11176:x1873908077737856:12345-0@lo:104: Request processed in 45us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098181.077450:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787098181.077460:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787098181.077465:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:11176:x1873908077737984:12345-0@lo:104: 00010000:00010000:2.0:1787098181.077472:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077547:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787098181.077553:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:11176:x1873908077737984:12345-0@lo:104: Request processed in 87us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098181.077559:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787098181.077576:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787098181.077581:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077589:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7000 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098181.077593:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077602:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098181.077609:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098181.077616:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787098181.077645:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077652:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098181.077673:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077680:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d72421c7000/0xb1d871f9b0144718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014471f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077708:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787098181.077712:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077719:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413e00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098181.077722:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077729:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098181.077736:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098181.077742:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787098181.077756:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077763:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098181.077782:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077791:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b014470a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144711 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077802:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098181.077806:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.077818:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077737728:0@lo:104: 00010000:00010000:2.0:1787098181.077829:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413600 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098181.077833:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.077835:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077737856:0@lo:104: 00010000:00010000:2.0:1787098181.077842:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098181.077848:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098181.077853:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787098181.077867:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077874:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787098181.077881:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077737984:0@lo:104: 00010000:00010000:2.0:1787098181.077883:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077892:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b01446fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144703 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.077908:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098181.077910:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098181.077912:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098181.077919:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098181.077937:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077738368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787098181.077972:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098181.078027:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787098181.078034:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077738496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787098181.078063:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787098181.078394:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098181.080815:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077738368 00000100:00100000:1.0:1787098181.080829:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077738368 00010000:00010000:1.0:1787098181.080875:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014470a expref: 19 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.080923:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077738496 00000100:00100000:1.0:1787098181.080927:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077738496 00010000:00010000:1.0:1787098181.080940:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01446fc expref: 20 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.080955:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787098181.080963:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d721fa9b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+20:3309:x1873908077738368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787098181.080977:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098181.080982:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014470a expref: 20 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.080992:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b014470a expref: 20 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.081009:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227413800/0xb1d871f9b0144711 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b014470a expref: 20 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.081023:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098181.081533:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077738240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098181.081598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098181.082524:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787098181.082551:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787098181.082695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098181.082832:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d721fa9b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077738368:12345-0@lo:103:ldlm_bl.0 Request processed in 1867us (4856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098181.082842:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787098181.082899:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077738240 00000100:00100000:1.0:1787098181.082906:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077738240 00010000:00010000:1.0:1787098181.082931:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144718 expref: 19 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.082962:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059879168 00000100:00100000:1.0:1787098181.082965:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059879168 00010000:00010000:1.0:1787098181.082980:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ed expref: 13 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.082996:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787098181.083007:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077738496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787098181.083018:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098181.083023:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01446fc expref: 19 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.083044:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01446fc expref: 19 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.083060:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227413000/0xb1d871f9b0144703 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01446fc expref: 19 pid: 5838 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.083072:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098181.083101:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:3309:x1873908077738496:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (5037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098181.083108:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787098181.083121:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787098181.083127:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:3312:x1873908077738240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787098181.083135:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098181.083138:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144718 expref: 17 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.083146:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144718 expref: 17 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.083164:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227412e00/0xb1d871f9b014471f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144718 expref: 17 pid: 5836 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.083181:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098181.083217:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3312:x1873908077738240:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098181.083224:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787098181.083236:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1787098181.083242:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059879168:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098181.083250:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098181.083255:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ed expref: 13 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.083264:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ed expref: 13 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.083276:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098181.083307:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077738240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787098181.083337:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059879168:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 93us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098181.083344:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00010000:00010000:1.0:1787098181.083439:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200030600/0xb1d871f9b0144734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ed expref: 12 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.083449:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077737600:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098181.083796:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077738496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787098181.083807:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077738368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787098181.085901:0:11176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11176:1873908077738112:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098181.085942:0:11176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098181.086138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098181.086583:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059879296 00000100:00100000:2.0:1787098181.086592:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059879296 00010000:00010000:2.0:1787098181.086624:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873b5 expref: 12 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098181.086662:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1787098181.086673:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:2374:x1873908059879296:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098181.086687:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098181.086758:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873b5 expref: 12 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086771:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873b5 expref: 12 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086789:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227413c00/0xb1d871f9b01446f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873b5 expref: 12 pid: 5839 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086806:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086815:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086832:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086919:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086928:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086934:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086940:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098181.086943:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086951:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086970:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098181.086981:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787098181.087098:0:11176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098181.087137:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:2374:x1873908059879296:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 466us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098181.087146:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00010000:00010000:1.0:1787098181.087188:0:11176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098181.087196:0:11176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208695a00/0xb1d871f9b0144750 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098182.032302:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098182.290621:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077738752:0@lo:400:kworker.0 00000100:00100000:0.0:1787098182.290908:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077738624:0@lo:400:kworker.0 00000100:00100000:1.0:1787098182.290960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098182.290979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098182.293161:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077739264:0@lo:400:kworker.0 00000100:00100000:0.0:1787098182.293161:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077739136:0@lo:400:kworker.0 00000100:00100000:0.0:1787098182.293265:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098182.293354:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098182.293393:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077738752 00000100:00100000:0.0:1787098182.293393:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077738624 00000100:00100000:0.0:1787098182.293404:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077738624 00000100:00100000:3.0:1787098182.293405:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077738752 00000100:00100000:1.0:1787098182.293436:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077738880:0@lo:400:kworker.0 00000100:00100000:1.0:1787098182.293464:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098182.293490:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787098182.293497:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077739008:0@lo:400:kworker.0 00000100:00100000:1.0:1787098182.293518:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098182.293619:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077739136 00000100:00100000:1.0:1787098182.293627:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077739136 00000100:00100000:0.0:1787098182.293669:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787098182.293682:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3311:x1873908077738624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098182.293740:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077738880 00000100:00100000:3.0:1787098182.293747:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077738880 00000100:00100000:1.0:1787098182.293751:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787098182.293770:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077738752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098182.293793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787098182.293805:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077739136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098182.293942:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3311:x1873908077738624:12345-0@lo:400:kworker.0 Request processed in 261us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098182.293955:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077739136:12345-0@lo:400:kworker.0 Request processed in 150us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098182.293955:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787098182.293967:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787098182.293986:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077738752:12345-0@lo:400:kworker.0 Request processed in 217us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098182.293995:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787098182.294008:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787098182.294050:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077739264 00000100:00100000:0.0:1787098182.294118:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077738624:0@lo:400:kworker.0 00000100:00100000:0.0:1787098182.294134:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077739136:0@lo:400:kworker.0 00000100:00100000:1.0:1787098182.294164:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077739264 00000100:00100000:3.0:1787098182.294330:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077738880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098182.294336:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077739008 00000100:00100000:1.0:1787098182.294342:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077739008 00000100:00100000:3.0:1787098182.294392:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077738880:12345-0@lo:400:kworker.0 Request processed in 386us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098182.294400:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787098182.294410:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077739264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098182.294428:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787098182.294472:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077739264:12345-0@lo:400:kworker.0 Request processed in 61us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098182.294478:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787098182.294491:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787098182.294497:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077739008:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787098182.294526:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098182.294532:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098182.294535:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098182.294553:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077739008:12345-0@lo:400:kworker.0 Request processed in 60us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098182.294561:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787098182.294608:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1ed80 x1873908077739008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098182.294622:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077739008:0@lo:400:kworker.0 00000100:00100000:3.0:1787098182.294644:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077738880:0@lo:400:kworker.0 00000100:00100000:1.0:1787098182.294648:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077738752:0@lo:400:kworker.0 00010000:00080000:1.0:1787098182.294690:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b726d80 x1873908077739264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098182.294702:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077739264:0@lo:400:kworker.0 00000100:00100000:0.0:1787098182.800671:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787098182.800694:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077739392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787098182.800821:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098182.801549:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077739392 00000100:00100000:0.0:1787098182.801559:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077739392 00000100:00100000:0.0:1787098182.801610:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787098182.801630:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077739392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098182.801665:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098182.801715:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077739392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098182.801722:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787098182.801822:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72416fd500 x1873908077739392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098182.801842:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077739392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098182.933497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098182.937264:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059879424 00000100:00100000:3.0:1787098182.937290:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059879424 00000100:00100000:3.0:1787098182.937368:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:3.0:1787098182.937378:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:5612:x1873908059879424:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098182.937396:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098182.937417:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287417 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098182.937446:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287417 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098182.937457:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287417 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098182.937466:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6800, rc 0) 00000100:00100000:3.0:1787098182.937548:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059879424:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 170us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098182.937555:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:0.0:1787098182.942530:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098182.942596:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059879552 00000100:00100000:1.0:1787098182.942607:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059879552 00000100:00100000:1.0:1787098182.942662:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 225 00000100:00100000:1.0:1787098182.942673:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059879552:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098182.943591:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059879552:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 916us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098182.943600:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 225 00000100:00100000:1.0:1787098182.946830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098182.946906:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059879680 00000100:00100000:2.0:1787098182.946919:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059879680 00000100:00100000:2.0:1787098182.947015:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:2.0:1787098182.947026:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059879680:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098182.947415:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059879680:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 389us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098182.947430:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:3.0:1787098182.959950:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098182.960312:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059879808 00000100:00100000:2.0:1787098182.960324:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059879808 00000100:00100000:2.0:1787098182.960384:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 227 00000100:00100000:2.0:1787098182.960394:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059879808:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098182.960412:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098182.960432:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e528741e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098182.960462:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528741e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098182.960474:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528741e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098182.960483:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030400, rc 0) 00000100:00100000:2.0:1787098182.960541:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059879808:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 148us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098182.960548:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 227 00000100:00100000:3.0:1787098182.963515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098182.963734:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059879936 00000100:00100000:2.0:1787098182.963747:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059879936 00000100:00100000:2.0:1787098182.963837:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:2.0:1787098182.963847:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059879936:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098182.964166:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059879936:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 320us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098182.964174:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:1.0:1787098182.966460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098182.968595:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059880064 00000100:00100000:3.0:1787098182.968608:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059880064 00000100:00100000:3.0:1787098182.968661:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:3.0:1787098182.968669:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059880064:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098182.968876:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059880064:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 207us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098182.968884:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 229 10000000:01000000:2.0:1787098182.991338:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787098182.991346:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7104c23800 from 7 10000000:01000000:2.0:1787098182.991352:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787098182.991457:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098182.991470:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098182.991482:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098182.991516:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077739520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787098182.991592:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098182.991641:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206510480 going to sleep for 11 seconds 00000100:00100000:1.0:1787098182.992184:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077739520 00000100:00100000:1.0:1787098182.992193:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077739520 00000100:00100000:1.0:1787098182.992251:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787098182.992261:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077739520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098182.992298:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098182.992315:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144765 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098182.992339:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144765 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098182.992350:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144765 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098182.992358:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413800, rc 0) 00000100:00100000:1.0:1787098182.993001:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077739520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 740us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098182.993019:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787098182.993345:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077739520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098182.993364:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098182.993380:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098182.993446:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077739648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098182.993479:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098182.993547:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077739648 00000100:00100000:1.0:1787098182.993553:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077739648 00000100:00100000:2.0:1787098182.993593:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206510480 going to sleep for 11 seconds 00000100:00100000:1.0:1787098182.993854:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787098182.993863:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077739648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098182.994579:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077739648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 716us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098182.994587:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787098182.994918:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077739648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098182.994962:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077739776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787098182.995005:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098182.995055:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a78e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787098182.995131:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077739776 00000100:00100000:1.0:1787098182.995210:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077739776 00000100:00100000:1.0:1787098182.995358:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787098182.995368:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077739776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098182.995570:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077739776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098182.995587:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787098182.995663:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077739776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787098182.996789:0:11279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787098182.996902:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787098182.997013:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787098182.997024:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098182.997035:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098182.997045:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787098182.997047:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7227639800 from 7 10000000:01000000:1.0:1787098182.997050:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787098182.997081:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098182.997089:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098182.997099:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098182.997121:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077739904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787098182.997342:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098182.997389:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787098182.997629:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077739904 00000100:00100000:2.0:1787098182.997636:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077739904 00000100:00100000:2.0:1787098182.997686:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787098182.997696:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077739904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098182.997721:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098182.997736:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144773 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098182.997761:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144773 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098182.997773:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144773 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098182.997783:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030600, rc 0) 00000100:00100000:2.0:1787098182.997831:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077739904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098182.997838:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787098182.997949:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077739904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098182.997963:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098182.997973:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098182.998171:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098182.998202:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098182.998225:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787098182.998239:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077740032 00000100:00100000:1.0:1787098182.998242:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077740032 00000100:00100000:1.0:1787098182.998265:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787098182.998273:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077740032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098182.999802:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077740032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1521us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098182.999815:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787098183.000847:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098183.000923:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098183.000994:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098183.001041:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722018e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787098183.001055:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077740160 00000100:00100000:1.0:1787098183.001073:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077740160 00000100:00100000:1.0:1787098183.001122:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787098183.001132:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077740160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098183.001351:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077740160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098183.001360:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787098183.001696:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787098183.002722:0:11280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787098183.002902:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787098183.002921:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787098183.002932:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098183.002943:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098183.002954:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787098183.002968:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d72079cb000 from 7 10000000:01000000:1.0:1787098183.002971:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787098183.003004:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098183.003014:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098183.003024:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098183.003066:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b724380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787098183.003120:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098183.003165:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787098183.003184:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077740288 00000100:00100000:1.0:1787098183.003190:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077740288 00000100:00100000:1.0:1787098183.003233:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787098183.003243:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077740288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098183.003254:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098183.003266:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0144781 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098183.003302:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0144781 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098183.003313:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144781 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098183.003321:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413e00, rc 0) 00000100:00100000:1.0:1787098183.003353:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077740288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098183.003366:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787098183.003379:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b724380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098183.003392:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098183.003400:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098183.003445:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098183.003485:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098183.003588:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a78e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787098183.003601:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077740416 00000100:00100000:1.0:1787098183.003605:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077740416 00000100:00100000:1.0:1787098183.003634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787098183.003640:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077740416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098183.003884:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077740416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098183.003891:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787098183.003956:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098183.003987:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098183.004022:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098183.004155:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722018e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787098183.004198:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077740544 00000100:00100000:1.0:1787098183.004202:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077740544 00000100:00100000:1.0:1787098183.004261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787098183.004268:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077740544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098183.004426:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077740544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098183.004433:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787098183.004520:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077740544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787098183.005694:0:11281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787098183.005754:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787098183.005772:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787098183.005782:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098183.005794:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098183.057946:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787098183.346221:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1944369d-673b-48ef-ae48-bb74d2b5ab81 00000020:00000080:1.0:1787098183.346237:0:6727:0:(genops.c:906:class_export_put()) final put ffff8d723b571800/1944369d-673b-48ef-ae48-bb74d2b5ab81 00000020:00000080:0.0:1787098183.346308:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723b571800/1944369d-673b-48ef-ae48-bb74d2b5ab81 for lustre-OST0000 00000020:00000080:0.0:1787098183.348148:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d723b573800 for lustre-OST0000 00010000:00010000:2.0:1787098184.081831:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787098184.330268:0:11377:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00100000:0.0:1787098184.384167:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1944369d-673b-48ef-ae48-bb74d2b5ab81 00000020:00000080:0.0:1787098184.384177:0:7660:0:(genops.c:906:class_export_put()) final put ffff8d723b44f800/1944369d-673b-48ef-ae48-bb74d2b5ab81 00000020:00000080:0.0:1787098184.384202:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723b44f800/1944369d-673b-48ef-ae48-bb74d2b5ab81 for lustre-OST0001 00000020:00000080:0.0:1787098184.384720:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d723b44a800 for lustre-OST0001 00000100:00100000:0.0:1787098184.727247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098184.727338:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098184.727363:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098184.727458:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059880192 00000100:00100000:1.0:1787098184.727469:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059880192 00000100:00100000:1.0:1787098184.727531:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:1.0:1787098184.727541:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2376:x1873908059880192:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098184.727617:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2376:x1873908059880192:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 77us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098184.727624:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:3.0:1787098184.728019:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059880448 00000100:00100000:3.0:1787098184.728024:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059880448 00000100:00100000:3.0:1787098184.728077:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059880320 00000100:00100000:3.0:1787098184.728081:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059880320 00000100:00100000:3.0:1787098184.728118:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:3.0:1787098184.728127:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2376:x1873908059880448:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098184.728167:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2376:x1873908059880448:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 42us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098184.728173:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:3.0:1787098184.728187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:3.0:1787098184.728193:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059880320:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098184.728215:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059880320:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098184.728221:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00080000:1.0:1787098184.728970:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098184.848934:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098184.849309:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077740672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098184.849378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098184.849687:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077740672 00000100:00100000:0.0:1787098184.849697:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077740672 00000100:00100000:0.0:1787098184.849804:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787098184.849816:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077740672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098184.849850:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098184.849912:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077740672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098184.849919:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787098184.850035:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f93b80 x1873908077740672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098184.850053:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077740672:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787098184.850108:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787098185.105341:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098186.129025:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098187.152398:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098187.407608:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077741056:0@lo:400:kworker.0 00000100:00100000:0.0:1787098187.407687:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098187.407752:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098187.407759:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077741184:0@lo:400:kworker.0 00000100:00100000:0.0:1787098187.407787:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098187.407823:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077741056 00000100:00100000:0.0:1787098187.407830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077741056 00000100:00100000:0.0:1787098187.407880:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787098187.407891:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077741056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098187.407960:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077741056:12345-0@lo:400:kworker.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098187.407968:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787098187.407989:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077741184 00000100:00100000:0.0:1787098187.407993:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077741184 00000100:00100000:0.0:1787098187.408020:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787098187.408027:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077741184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098187.408072:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077741184:12345-0@lo:400:kworker.0 Request processed in 46us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098187.408078:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787098187.408093:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787098187.408097:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787098187.408127:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72416ff800 x1873908077741184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098187.408140:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077741184:0@lo:400:kworker.0 00000100:00100000:0.0:1787098187.408152:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077741056:0@lo:400:kworker.0 00000100:00100000:1.0:1787098187.408327:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077740800:0@lo:400:kworker.0 00000100:00100000:1.0:1787098187.408361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098187.408396:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077741312:0@lo:400:kworker.0 00000100:00100000:1.0:1787098187.408419:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098187.408442:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787098187.408448:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077740928:0@lo:400:kworker.0 00000100:00100000:1.0:1787098187.408470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098187.408489:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077741440:0@lo:400:kworker.0 00000100:00100000:1.0:1787098187.408510:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098187.408534:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077741312 00000100:00100000:1.0:1787098187.408538:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077741312 00000100:00100000:1.0:1787098187.408569:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077740928 00000100:00100000:1.0:1787098187.408572:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077740928 00000100:00100000:1.0:1787098187.408587:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787098187.408594:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077741312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098187.408639:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077741312:12345-0@lo:400:kworker.0 Request processed in 45us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098187.408646:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787098187.408659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787098187.408664:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077740928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098187.408690:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077740928:12345-0@lo:400:kworker.0 Request processed in 26us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098187.408697:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787098187.408716:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077741440 00000100:00100000:1.0:1787098187.408719:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077741440 00000100:00100000:1.0:1787098187.408744:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787098187.408750:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077741440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098187.408778:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077741440:12345-0@lo:400:kworker.0 Request processed in 29us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098187.408784:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787098187.408801:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098187.408804:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098187.408822:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077740928:0@lo:400:kworker.0 00010000:00080000:1.0:1787098187.408832:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1d500 x1873908077741440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098187.408840:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077741440:0@lo:400:kworker.0 00000100:00100000:1.0:1787098187.408848:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077741312:0@lo:400:kworker.0 00000100:00100000:0.0:1787098187.409046:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077740800 00000100:00100000:0.0:1787098187.409074:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077740800 00000100:00100000:0.0:1787098187.409109:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787098187.409118:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077740800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098187.409273:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077740800:12345-0@lo:400:kworker.0 Request processed in 157us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098187.409309:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787098187.414771:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077740800:0@lo:400:kworker.0 00000001:02000400:2.0:1787098187.658938:0:11478:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:09:46 (1787098186) === 00000100:00100000:0.0:1787098187.856056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098187.856178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098187.856420:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059880576 00000100:00100000:1.0:1787098187.856430:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059880576 00000100:00100000:1.0:1787098187.856504:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1787098187.856531:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2375:x1873908059880576:12345-192.168.204.51@tcp:41:mkdir.0 00000004:00000024:1.0:1787098187.856582:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787098187.856717:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2375:x1873908059880576:12345-192.168.204.51@tcp:41:mkdir.0 Request processed in 188us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098187.856724:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00080000:0.0:1787098187.856985:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098187.857712:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059880704 00000100:00100000:3.0:1787098187.857721:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059880704 00000100:00100000:3.0:1787098187.857774:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1787098187.857784:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:9717:x1873908059880704:12345-192.168.204.51@tcp:700:mkdir.0 00000100:00100000:3.0:1787098187.857850:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:9717:x1873908059880704:12345-192.168.204.51@tcp:700:mkdir.0 Request processed in 68us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098187.857856:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1787098187.862557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098187.862649:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059880960 00000100:00100000:1.0:1787098187.862660:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059880960 00000100:00100000:1.0:1787098187.862717:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1787098187.862726:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:9717:x1873908059880960:12345-192.168.204.51@tcp:36:mkdir.0 00010000:00010000:1.0:1787098187.862791:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098187.862874:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b0144670 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873a0 expref: 6 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.862899:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:1.0:1787098187.862913:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787098187.863433:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.863448:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.863457:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.863468:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.863475:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.863492:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098187.867825:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787098187.867849:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.867859:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.867866:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.867871:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098187.867876:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.867883:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.867902:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f100) 00010000:00010000:1.0:1787098187.867905:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098187.867910:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.867915:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014478f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787098187.867938:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f3d7098 reply state 000000001daf3be6 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098187.868230:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787098187.868374:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:9717:x1873908059880960:12345-192.168.204.51@tcp:36:mkdir.0 Request processed in 5642us (5819us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787098187.868384:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:2.0:1787098187.870475:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.870492:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.870501:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.870508:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098187.870513:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.870521:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.870541:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098187.870544:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098187.870549:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.870555:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144796 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098187.880073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098187.880226:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059881088 00000100:00100000:1.0:1787098187.880236:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059881088 00000100:00100000:1.0:1787098187.880469:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1787098187.880481:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:9718:x1873908059881088:12345-192.168.204.51@tcp:101:chmod.0 00010000:00010000:1.0:1787098187.880503:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098187.880526:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014479d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287425 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.880597:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.880610:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.880621:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098187.880682:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787098187.880686:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787098187.880739:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.880768:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b014479d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287425 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.880806:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287425 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.880814:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f100) 00010000:00010000:1.0:1787098187.880817:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787098187.880820:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413400, rc 0) 00000100:00100000:1.0:1787098187.880879:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:9718:x1873908059881088:12345-192.168.204.51@tcp:101:chmod.0 Request processed in 400us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098187.880886:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1787098187.886995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098187.887147:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059881344 00000100:00100000:2.0:1787098187.887158:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059881344 00000100:00100000:2.0:1787098187.887223:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1787098187.887234:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:9718:x1873908059881344:12345-192.168.204.51@tcp:36:chmod.0 00010000:00010000:2.0:1787098187.887347:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098187.887374:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287425 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.887394:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f100) 00010000:00010000:2.0:1787098187.887406:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098187.887431:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.887444:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.887453:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787098187.887766:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ac4daac reply state 00000000d573b3bb transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098187.887776:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787098187.887790:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787098187.887868:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+8:9718:x1873908059881344:12345-192.168.204.51@tcp:36:chmod.0 Request processed in 636us (884us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787098187.887875:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00010000:00010000:0.0:1787098187.895492:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098187.895512:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098187.895520:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098187.895526:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098187.895531:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098187.895540:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098187.895558:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203ead000) 00010000:00010000:0.0:1787098187.895562:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787098187.895566:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098187.895573:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622000/0xb1d871f9b01447ab lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098187.918688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098187.919064:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059881472 00000100:00100000:1.0:1787098187.919076:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059881472 00000100:00100000:1.0:1787098187.919248:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1787098187.919259:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:9719:x1873908059881472:12345-192.168.204.51@tcp:101:chown.0 00010000:00010000:1.0:1787098187.919348:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098187.919378:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01447b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528742c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.919455:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.919469:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.919481:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098187.919538:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787098187.919554:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787098187.919600:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.919625:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01447b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528742c expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.919644:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528742c expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098187.919653:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00010000:00010000:1.0:1787098187.919655:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787098187.919659:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413400, rc 0) 00000100:00100000:1.0:1787098187.919716:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+8:9719:x1873908059881472:12345-192.168.204.51@tcp:101:chown.0 Request processed in 459us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098187.919723:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1787098187.919873:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077741568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787098187.919927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098187.920010:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077741568 00000100:00100000:0.0:1787098187.920022:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077741568 00000100:00100000:0.0:1787098187.920072:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787098187.920080:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077741568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098187.920109:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098187.920156:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077741568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098187.920162:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787098187.920199:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72416ff800 x1873908077741568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098187.920215:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077741568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098187.923482:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098187.923600:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059881600 00000100:00100000:2.0:1787098187.923611:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059881600 00000100:00100000:2.0:1787098187.923699:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:2.0:1787098187.923709:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+8:9719:x1873908059881600:12345-192.168.204.51@tcp:101:chown.0 00010000:00010000:2.0:1787098187.923729:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098187.923751:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287433 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.923843:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.923857:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.923867:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.923882:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.923890:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.923897:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924002:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924010:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924016:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098187.924065:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787098187.924070:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098187.924098:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924121:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924127:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924132:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924138:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098187.924142:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924160:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924172:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00010000:00010000:2.0:1787098187.924175:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098187.924180:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924186:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01447c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924200:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924207:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924212:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924223:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098187.924226:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924232:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924240:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d7203eade00) 00010000:00010000:2.0:1787098187.924242:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098187.924244:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924250:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01447ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924317:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287433 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924331:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287433 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.924338:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:2.0:1787098187.924341:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098187.924343:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623e00, rc 0) 00000100:00100000:2.0:1787098187.924399:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+9:9719:x1873908059881600:12345-192.168.204.51@tcp:101:chown.0 Request processed in 691us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098187.924407:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1787098187.928744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098187.928899:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059881856 00000100:00100000:2.0:1787098187.928923:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059881856 00000100:00100000:2.0:1787098187.929135:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1787098187.929157:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+9:9719:x1873908059881856:12345-192.168.204.51@tcp:36:chown.0 00010000:00010000:2.0:1787098187.929214:0:6853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098187.929244:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287433 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.929266:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:2.0:1787098187.929311:0:6853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098187.929338:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.929352:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098187.929361:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787098188.000971:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1787098188.000993:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787098188.002702:0:6853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006043fcab reply state 000000000b6504e7 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098188.002722:0:6853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787098188.002908:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787098188.003187:0:6853:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787098188.003209:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:9719:x1873908059881856:12345-192.168.204.51@tcp:36:chown.0 Request processed in 74060us (74471us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787098188.003219:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00010000:00010000:0.0:1787098188.004217:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.004231:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.004239:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.004245:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098188.004249:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.004257:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.004273:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7203eada00) 00010000:00010000:0.0:1787098188.004276:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787098188.005407:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.005418:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01447dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098188.021389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098188.021660:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059881984 00000100:00100000:1.0:1787098188.021673:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059881984 00000100:00100000:1.0:1787098188.021757:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1787098188.021767:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:9720:x1873908059881984:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:1.0:1787098188.021792:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098188.021813:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01447e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528743a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787098188.028499:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6634us 00010000:00010000:2.0:1787098188.063936:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.063970:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.063998:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.064017:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.064025:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.064031:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.064819:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01447f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.064830:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01447f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.064839:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01447f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098188.064926:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787098188.064935:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098188.065057:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01447f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065071:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065077:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065084:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065090:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098188.065095:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065102:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065114:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00010000:00010000:3.0:1787098188.065117:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098188.065321:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065328:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01447ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065343:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065349:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065365:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065371:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098188.065374:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065380:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065388:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d7203eadc00) 00010000:00010000:3.0:1787098188.065391:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098188.065393:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065398:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01447f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065438:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01447e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528743a expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065455:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01447f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528743a expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.065463:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7207e92200) 00010000:00010000:3.0:1787098188.065466:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787098188.065468:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7c00, rc 0) 00000100:00100000:3.0:1787098188.065560:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:9720:x1873908059881984:12345-192.168.204.51@tcp:101:touch.500 Request processed in 43792us (44181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098188.065576:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1787098188.069204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098188.069329:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059882240 00000100:00100000:0.0:1787098188.069340:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059882240 00000100:00100000:0.0:1787098188.069414:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1787098188.069426:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:9720:x1873908059882240:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:0.0:1787098188.069457:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098188.069480:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695c00/0xb1d871f9b01447ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287441 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.070262:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.070397:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.070412:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.070453:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.070462:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.070469:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787098188.072905:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787098188.073852:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694600/0xb1d871f9b0144814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.073871:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694600/0xb1d871f9b0144814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.073883:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694600/0xb1d871f9b0144814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.073924:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.073932:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.073938:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.073945:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098188.073949:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.073956:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.075139:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7207e92200) 00010000:00010000:0.0:1787098188.075147:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098188.075154:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.075188:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144806 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787098188.075208:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a25eec16 reply state 000000002967fe42 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098188.075220:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787098188.075292:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695c00/0xb1d871f9b01447ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287441 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.075372:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694600/0xb1d871f9b0144814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287441 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.075381:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7208701200) 00010000:00010000:0.0:1787098188.075383:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098188.075386:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694600, rc 0) 00000100:00100000:0.0:1787098188.075534:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+10:9720:x1873908059882240:12345-192.168.204.51@tcp:101:touch.500 Request processed in 6109us (6341us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787098188.075543:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00010000:00010000:2.0:1787098188.079491:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.079512:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.079520:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.079527:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098188.079531:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.079539:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.079560:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x65d33690 (ffff8d7208701300) 00010000:00010000:2.0:1787098188.079563:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098188.079567:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.079589:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695400/0xb1d871f9b014480d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098188.082132:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098188.082722:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059882496 00000100:00100000:2.0:1787098188.082734:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059882496 00000100:00100000:2.0:1787098188.082799:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1787098188.082810:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+9:9720:x1873908059882496:12345-192.168.204.51@tcp:36:touch.500 00010000:00010000:2.0:1787098188.082875:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098188.082902:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694600/0xb1d871f9b0144814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287441 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.082925:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7208701200) 00010000:00010000:2.0:1787098188.082936:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098188.082982:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.082998:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.083009:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787098188.083349:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ad7cd8b reply state 000000006c68e4ac transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098188.083359:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787098188.083467:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+10:9720:x1873908059882496:12345-192.168.204.51@tcp:36:touch.500 Request processed in 659us (1343us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787098188.083475:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00010000:00010000:1.0:1787098188.085864:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.085903:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.085910:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.085916:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098188.085920:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.085928:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.085946:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:1.0:1787098188.086715:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098188.086724:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.086732:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144822 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098188.088974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098188.089086:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059882624 00000100:00100000:2.0:1787098188.089096:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059882624 00000100:00100000:2.0:1787098188.089170:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1787098188.089181:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+9:9720:x1873908059882624:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:2.0:1787098188.089216:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098188.089239:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144829 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287448 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.089322:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144829 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287448 expref: 10 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.089337:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144829 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287448 expref: 10 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.089355:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7203ead900) 00010000:00010000:2.0:1787098188.089358:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098188.089361:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623600, rc 0) 00000100:00100000:2.0:1787098188.089434:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+10:9720:x1873908059882624:12345-192.168.204.51@tcp:101:touch.500 Request processed in 255us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098188.089442:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:0.0:1787098188.095165:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098188.096620:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059882752 00000100:00100000:1.0:1787098188.096634:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059882752 00000100:00100000:1.0:1787098188.096694:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1787098188.096704:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2372:x1873908059882752:12345-192.168.204.51@tcp:8:touch.500 00010000:00080000:1.0:1787098188.096737:0:6702:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:1.0:1787098188.096774:0:6702:0:(genops.c:1406:class_connect()) connect: client 530d6019-f48b-45e0-97e8-95fbd128e52b, cookie 0xb1d871f9b0144830 00002000:00100000:1.0:1787098188.096786:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 530d6019-f48b-45e0-97e8-95fbd128e52b/ffff8d710499f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787098188.096821:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787098188.097061:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787098188.097091:0:6702:0:(import.c:65:import_set_state_nolock()) ffff8d710499a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098188.097173:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2372:x1873908059882752:12345-192.168.204.51@tcp:8:touch.500 Request processed in 468us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098188.097187:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1787098188.100841:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098188.100983:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059882880 00000100:00100000:1.0:1787098188.100997:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059882880 00000100:00100000:1.0:1787098188.101100:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1787098188.101112:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:0:x1873908059882880:12345-192.168.204.51@tcp:2:touch.500 00000100:00080000:0.0:1787098188.101594:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787098188.155660:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1787098188.155684:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000100:00100000:1.0:1787098188.155923:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:0:x1873908059882880:12345-192.168.204.51@tcp:2:touch.500 Request processed in 54802us (55083us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787098188.155937:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1787098188.166043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098188.166359:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059883136 00000100:00100000:0.0:1787098188.166373:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059883136 00000100:00100000:0.0:1787098188.166453:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:0.0:1787098188.166465:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+10:9720:x1873908059883136:12345-192.168.204.51@tcp:35:touch.500 00000100:00100000:0.0:1787098188.167005:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+11:9720:x1873908059883136:12345-192.168.204.51@tcp:35:touch.500 Request processed in 530us (976us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787098188.167044:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00010000:00010000:3.0:1787098188.181553:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098188.194977:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098188.195107:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059883264 00000100:00100000:1.0:1787098188.195121:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059883264 00000100:00100000:1.0:1787098188.195271:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1787098188.195332:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+11:9721:x1873908059883264:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:1.0:1787098188.195367:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098188.195400:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b0144837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528744f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.195491:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014483e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.195508:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014483e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.195522:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014483e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098188.195631:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787098188.195636:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787098188.195694:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014483e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.195731:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b0144837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528744f expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.195755:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014483e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528744f expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.195765:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7207e92200) 00010000:00010000:1.0:1787098188.195768:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787098188.195771:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412200, rc 0) 00000100:00100000:1.0:1787098188.195862:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+12:9721:x1873908059883264:12345-192.168.204.51@tcp:101:rm.0 Request processed in 580us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098188.195871:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1787098188.198852:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098188.198949:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059883520 00000100:00100000:0.0:1787098188.198961:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059883520 00000100:00100000:0.0:1787098188.199041:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:0.0:1787098188.199261:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+12:9721:x1873908059883520:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:0.0:1787098188.199331:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098188.199361:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144845 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287456 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098188.199506:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787098188.199725:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144845 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287456 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.199743:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00010000:00010000:0.0:1787098188.199747:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787098188.199752:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b0144845 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287456 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098188.199769:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695a00, rc 0) 00000100:00100000:0.0:1787098188.199838:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:9721:x1873908059883520:12345-192.168.204.51@tcp:101:rm.0 Request processed in 788us (1001us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787098188.199845:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:3.0:1787098188.203570:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098188.203936:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059883648 00000100:00100000:2.0:1787098188.203947:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059883648 00000100:00100000:2.0:1787098188.204232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1787098188.204243:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+13:9721:x1873908059883648:12345-192.168.204.51@tcp:37:rm.0 00000100:00100000:3.0:1787098188.211764:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+13:9721:x1873908059883648:12345-192.168.204.51@tcp:37:rm.0 Request processed in 7512us (8193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098188.211777:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1787098188.216266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098188.216410:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059883904 00000100:00100000:0.0:1787098188.216421:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059883904 00000100:00100000:0.0:1787098188.216582:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1787098188.216598:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+13:9721:x1873908059883904:12345-192.168.204.51@tcp:35:rm.0 00000100:00100000:0.0:1787098188.216877:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+14:9721:x1873908059883904:12345-192.168.204.51@tcp:35:rm.0 Request processed in 281us (619us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787098188.216885:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1787098188.221891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098188.222045:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059884160 00000100:00100000:3.0:1787098188.222056:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059884160 00000100:00100000:3.0:1787098188.222191:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1787098188.222203:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+14:9721:x1873908059884160:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:3.0:1787098188.222227:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098188.222249:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528745d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.222427:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014485a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.222441:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014485a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.222453:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014485a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098188.222477:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787098188.222614:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528745d expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.222635:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014485a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528745d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.222660:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7207e92200) 00010000:00010000:3.0:1787098188.222664:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787098188.222667:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6600, rc 0) 00000100:00100000:3.0:1787098188.222742:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+16:9721:x1873908059884160:12345-192.168.204.51@tcp:101:rm.0 Request processed in 541us (862us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787098188.222750:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1787098188.227389:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098188.227542:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059884288 00000100:00100000:1.0:1787098188.227553:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059884288 00000100:00100000:1.0:1787098188.227666:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1787098188.227678:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+16:9721:x1873908059884288:12345-192.168.204.51@tcp:41:rm.0 00000004:00000024:1.0:1787098188.227752:0:6853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787098188.227835:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+16:9721:x1873908059884288:12345-192.168.204.51@tcp:41:rm.0 Request processed in 159us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098188.227860:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1787098188.235726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098188.236074:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059884416 00000100:00100000:2.0:1787098188.236084:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059884416 00000100:00100000:2.0:1787098188.236218:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1787098188.236229:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+16:9721:x1873908059884416:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:2.0:1787098188.236252:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098188.236273:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287464 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.236420:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.236435:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.236446:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.236474:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.236481:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.236487:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.236600:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b014487d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.236609:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b014487d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.236631:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b014487d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098188.236659:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787098188.236663:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098188.237377:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b014487d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237394:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b014487d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237403:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237409:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237414:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237420:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098188.237424:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237431:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237536:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7207e92200) 00010000:00010000:2.0:1787098188.237541:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098188.237546:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237564:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014486f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237578:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237584:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237589:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237593:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098188.237596:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237602:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237610:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x65d33690 (ffff8d7203eadf00) 00010000:00010000:2.0:1787098188.237612:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098188.237615:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237620:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237656:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287464 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237670:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b014487d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287464 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.237738:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7203ead900) 00010000:00010000:2.0:1787098188.237741:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098188.237743:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622a00, rc 0) 00000100:00100000:2.0:1787098188.237906:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+17:9721:x1873908059884416:12345-192.168.204.51@tcp:101:rm.0 Request processed in 1678us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098188.237915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1787098188.242573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098188.242702:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059884672 00000100:00100000:0.0:1787098188.242713:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059884672 00000100:00100000:1.0:1787098188.245584:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:1.0:1787098188.245610:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+17:9721:x1873908059884672:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:1.0:1787098188.245671:0:6853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787098188.245798:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b014487d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287464 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.245823:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144829 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287448 expref: 16 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.245835:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7203ead900) 00010000:00010000:1.0:1787098188.245850:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014483e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528744f expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.245860:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7207e92200) 00010000:00010000:1.0:1787098188.245863:0:6853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787098188.245884:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.245896:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.245906:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.245919:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.245938:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.245945:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.246225:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.246235:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.246243:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787098188.249407:0:6853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787098188.249427:0:6853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286505145857ns, next at 287505142206ns, rc = 0 00010000:00010000:1.0:1787098188.249733:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249749:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249761:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249769:0:6853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249775:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249797:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249826:0:6853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787098188.249852:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249859:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249866:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249871:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098188.249876:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.249880:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098188.249884:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.249888:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249899:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7208d7f500) 00010000:00010000:1.0:1787098188.249904:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787098188.249908:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.249913:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098188.249914:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144892 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.249920:0:6716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.249929:0:6716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249939:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.249941:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7208d7f500) 00010000:00010000:3.0:1787098188.249947:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787098188.249953:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.249961:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144899 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.249963:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.249978:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098188.249980:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.249982:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098188.249985:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098188.249989:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098188.249993:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.250001:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.250011:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7207e92200) 00010000:00010000:1.0:1787098188.250013:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098188.250016:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.250022:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144884 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787098188.250042:0:6853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037d00b27 reply state 00000000e328ca05 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098188.250051:0:6853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787098188.251396:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+16:9721:x1873908059884672:12345-192.168.204.51@tcp:36:rm.0 Request processed in 5787us (8822us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787098188.251408:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00010000:00010000:2.0:1787098188.255733:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.255752:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.255760:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.255768:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098188.255772:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.255780:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.255796:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x65d33690 (ffff8d7208d7ff00) 00010000:00010000:2.0:1787098188.255800:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098188.255805:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098188.255811:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b014488b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098188.257396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098188.257455:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059884928 00000100:00100000:2.0:1787098188.257466:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059884928 00000100:00100000:2.0:1787098188.257526:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1787098188.257536:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+15:9721:x1873908059884928:12345-192.168.204.51@tcp:35:rm.0 00000100:00100000:2.0:1787098188.257827:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+16:9721:x1873908059884928:12345-192.168.204.51@tcp:35:rm.0 Request processed in 292us (440us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787098188.257835:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1787098188.260442:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098188.260538:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059885184 00000100:00100000:3.0:1787098188.260548:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059885184 00000100:00100000:3.0:1787098188.260608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1787098188.260618:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+16:9721:x1873908059885184:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:3.0:1787098188.260672:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787098188.260700:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014485a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528745d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.260720:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01447f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528743a expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.260734:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7207e92200) 00010000:00010000:3.0:1787098188.260748:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413400/0xb1d871f9b01447b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528742c expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.260756:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00010000:00010000:3.0:1787098188.260776:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098188.260800:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.260812:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.260822:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.260836:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.260842:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.260863:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.261863:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.261889:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.261898:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098188.262692:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787098188.262714:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262724:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262732:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262740:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098188.262744:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262750:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262763:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7207e92800) 00010000:00010000:3.0:1787098188.262766:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787098188.262779:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262785:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b01448ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262816:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262822:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262828:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262833:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098188.262835:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262841:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262849:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:3.0:1787098188.262851:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098188.262853:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098188.262858:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b01448a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098188.262871:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028b4bd07 reply state 0000000036a46932 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098188.262890:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787098188.263437:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+15:9721:x1873908059885184:12345-192.168.204.51@tcp:36:rm.0 Request processed in 2814us (2999us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787098188.263446:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00010000:00010000:1.0:1787098188.268526:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.268543:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.268568:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.268575:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098188.268579:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.268587:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.268605:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d7207e92a00) 00010000:00010000:1.0:1787098188.268608:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098188.268612:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098188.268619:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01448a7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098189.202438:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098189.848333:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098189.848459:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059885440 00000100:00100000:1.0:1787098189.848472:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059885440 00000100:00100000:1.0:1787098189.848604:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:1.0:1787098189.848618:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+14:2375:x1873908059885440:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098189.848729:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+14:2375:x1873908059885440:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 114us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098189.848739:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:1.0:1787098189.848802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098189.848979:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059885696 00000100:00100000:3.0:1787098189.848985:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059885696 00000100:00100000:1.0:1787098189.849082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098189.849137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098189.849191:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059885568 00000100:00100000:1.0:1787098189.849196:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059885568 00000100:00100000:1.0:1787098189.849236:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1787098189.849245:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059885568:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098189.849322:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059885568:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 77us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098189.849334:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00080000:0.0:1787098189.849667:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098189.849690:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059885312 00000100:00100000:0.0:1787098189.849697:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059885312 00000100:00100000:0.0:1787098189.849749:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:0.0:1787098189.849759:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059885312:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098189.849805:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059885312:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 47us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098189.849814:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:3.0:1787098189.850435:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:3.0:1787098189.850448:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059885696:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098189.850510:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059885696:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 66us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098189.850521:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:0.0:1787098189.973047:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077741696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098189.973134:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098189.973206:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077741696 00000100:00100000:1.0:1787098189.973223:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077741696 00000004:00080000:3.0:1787098189.973335:0:6852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288229053115ns, next at 289229048493ns, rc = 0 00000100:00100000:1.0:1787098189.973356:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787098189.973369:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077741696:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787098189.973380:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787098189.973420:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098189.977633:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077741696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4250us (4483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098189.977652:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787098189.981071:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7104f90380 x1873908077741696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098189.981102:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077741696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787098190.226664:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098191.247525:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787098192.123760:0:11629:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787098192.272398:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098192.528517:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077742208:0@lo:400:kworker.0 00000100:00100000:3.0:1787098192.528522:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077742080:0@lo:400:kworker.0 00000100:00100000:1.0:1787098192.528573:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077741952:0@lo:400:kworker.0 00000100:00100000:2.0:1787098192.528632:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077741824:0@lo:400:kworker.0 00000100:00100000:0.0:1787098192.530035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098192.530136:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077742208 00000100:00100000:0.0:1787098192.530145:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077742208 00000100:00100000:0.0:1787098192.530201:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787098192.530222:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077742208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098192.530274:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077742208:12345-0@lo:400:kworker.0 Request processed in 56us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098192.530298:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1787098192.530352:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e1d880 x1873908077742208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098192.530365:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077742208:0@lo:400:kworker.0 00000100:00100000:1.0:1787098192.531778:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098192.531887:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077742464:0@lo:400:kworker.0 00000100:00100000:1.0:1787098192.531918:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098192.531981:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077742464 00000100:00100000:1.0:1787098192.531988:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077742464 00000100:00100000:1.0:1787098192.532036:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787098192.532045:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077742464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098192.532096:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077742464:12345-0@lo:400:kworker.0 Request processed in 52us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098192.532102:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787098192.532153:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e08a80 x1873908077742464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098192.532167:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077742464:0@lo:400:kworker.0 00000100:00100000:2.0:1787098192.536815:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098192.537103:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077741952 00000100:00100000:0.0:1787098192.537114:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077741952 00000100:00100000:0.0:1787098192.537172:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787098192.537182:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077741952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098192.537260:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077741952:12345-0@lo:400:kworker.0 Request processed in 80us (5488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098192.537267:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787098192.537341:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077741952:0@lo:400:kworker.0 00000100:00100000:3.0:1787098192.537444:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098192.537538:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077742336:0@lo:400:kworker.0 00000100:00100000:2.0:1787098192.537573:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787098192.537610:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787098192.537615:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098192.537625:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077741824 00000100:00100000:2.0:1787098192.537629:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077741824 00000100:00100000:2.0:1787098192.537654:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787098192.537660:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077741824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098192.537696:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077741824:12345-0@lo:400:kworker.0 Request processed in 36us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098192.537702:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787098192.537733:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077741824:0@lo:400:kworker.0 00000100:00100000:0.0:1787098192.538535:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077742080 00000100:00100000:0.0:1787098192.538543:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077742080 00000100:00100000:0.0:1787098192.538587:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077742336 00000100:00100000:0.0:1787098192.538591:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077742336 00000100:00100000:0.0:1787098192.538612:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787098192.538620:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077742080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098192.538686:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077742080:12345-0@lo:400:kworker.0 Request processed in 66us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098192.538693:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787098192.538708:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787098192.538714:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077742336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098192.538767:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077742336:12345-0@lo:400:kworker.0 Request processed in 53us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098192.538774:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787098192.538794:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098192.538823:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077742080:0@lo:400:kworker.0 00000100:00100000:2.0:1787098192.538957:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077742336:0@lo:400:kworker.0 00000100:00100000:1.0:1787098193.041566:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787098193.041590:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077742592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098193.041675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098193.042931:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077742592 00000100:00100000:3.0:1787098193.042964:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077742592 00000100:00100000:3.0:1787098193.043132:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787098193.043148:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077742592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787098193.043201:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098193.043486:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077742592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 342us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098193.043498:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787098193.045709:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e0b480 x1873908077742592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098193.045757:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077742592:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787098193.113750:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:3.0:1787098193.113775:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1787098193.113780:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787098193.113798:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1787098193.113806:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787098193.113810:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1787098193.114023:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077742720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787098193.114105:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098193.114173:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077742720 00000100:00100000:1.0:1787098193.114180:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077742720 00000100:00100000:1.0:1787098193.114233:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787098193.114242:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077742720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787098193.114272:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787098193.114334:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a84f44c, atime: 0x6a84f44c, ctime: 0x6a84f44c, blocks: 0x1 00010000:00010000:1.0:1787098193.114343:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.114361:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=291s v=(0 0) 00010000:00010000:1.0:1787098193.114366:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098193.114372:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.114391:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.114402:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.114410:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.114447:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098193.114653:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098193.114662:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.114670:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098193.114675:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.114684:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.114706:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.114714:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045d12a1c/0xb1d871f9b01448b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.114731:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098193.114733:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098193.114735:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098193.115208:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1873908077742720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 964us (1100us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787098193.115218:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1787098193.115494:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7104f90380/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787098193.115502:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077742720:0@lo:6:osp-syn-0-0.0 00000020:00000080:3.0:1787098193.154075:0:11678:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7bfa2640 20000000:00000080:3.0:1787098193.154096:0:11678:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d723b970800 uarg=0000000000000000 20000000:01000000:3.0:1787098193.154133:0:11678:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787098193.154140:0:11678:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787098193.154145:0:11678:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787098193.155399:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787098193.155579:0:11678:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787098193.164888:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787098193.164965:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787098193.165021:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787098193.165044:0:11678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787098193.165075:0:11678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165105:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287417 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165114:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528741e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165122:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144765 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165129:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144773 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165136:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0144781 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165144:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165203:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144781 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165223:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144781 expref: 18 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098193.165242:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077742848:0@lo:104: 00000100:00100000:1.0:1787098193.165364:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787098193.165456:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144773 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165466:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144773 expref: 18 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098193.165475:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077742976:0@lo:104: 00000100:00100000:1.0:1787098193.165503:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787098193.165528:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0144765 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.165537:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0144765 expref: 18 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098193.165546:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077743104:0@lo:104: 00000100:00100000:1.0:1787098193.165570:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787098193.176597:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528741e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.176623:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528741e expref: 12 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098193.176684:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077743232:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098193.176829:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287417 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.176838:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287417 expref: 12 pid: 5838 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098193.177465:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787098193.177501:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077742848 00000100:00100000:0.0:1787098193.177511:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077742848 00000100:00100000:0.0:1787098193.177560:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077742976 00000100:00100000:0.0:1787098193.177563:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077742976 00000100:00100000:0.0:1787098193.177574:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077743104 00000100:00100000:0.0:1787098193.177577:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077743104 00000100:00100000:0.0:1787098193.177594:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787098193.177603:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:11678:x1873908077742848:12345-0@lo:104: 00010000:00010000:0.0:1787098193.177623:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098193.177710:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787098193.177716:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+5:11678:x1873908077742848:12345-0@lo:104: Request processed in 114us (12356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098193.177723:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787098193.177740:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787098193.177837:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098193.177844:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.177852:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413600 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098193.177856:0:6716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.177878:0:6716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098193.177886:0:6716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098193.177892:0:6716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787098193.177954:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:3.0:1787098193.177965:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787098193.177970:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1787098193.178033:0:6716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.178039:0:6716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098193.178060:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.178067:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227413600/0xb1d871f9b0144781 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0144788 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.178080:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098193.178081:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098193.178083:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098193.178096:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077743488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098193.178130:0:11680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787098193.178132:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098193.178137:0:11680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7239f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:11678:x1873908077743104:12345-0@lo:104: 00010000:00010000:3.0:1787098193.178145:0:11680:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098193.178175:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077743488 00010000:00010000:3.0:1787098193.178181:0:11680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098193.178191:0:11680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7239f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+4:11678:x1873908077743104:12345-0@lo:104: Request processed in 55us (12620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098193.178198:0:11680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787098193.178212:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098193.178217:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.178224:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098193.178227:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.178235:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098193.178243:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098193.178249:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787098193.178256:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:11678:x1873908077742976:12345-0@lo:104: 00010000:00010000:3.0:1787098193.178266:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.178317:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098193.178328:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.178334:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7200031200/0xb1d871f9b0144765 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014476c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.178345:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098193.178347:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098193.178349:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098193.178374:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787098193.178383:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b1ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077743616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098193.178408:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787098193.178415:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098193.178436:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077743616 00000100:00100000:3.0:1787098193.178440:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077743616 00010000:00010000:0.0:1787098193.178451:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787098193.178456:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+3:11678:x1873908077742976:12345-0@lo:104: Request processed in 711us (12953us total) trans 0 rc 0/0 00010000:00010000:3.0:1787098193.178458:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144765 expref: 19 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098193.178468:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787098193.178496:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787098193.178502:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077743616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787098193.178512:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098193.178518:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144765 expref: 19 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098193.178518:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098193.178523:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098193.178529:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413c00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:0.0:1787098193.178532:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098193.178566:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077743488 00010000:00010000:2.0:1787098193.178583:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144781 expref: 20 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098193.178605:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787098193.178613:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+20:3311:x1873908077743488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787098193.178625:0:11678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077743360:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098193.178631:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098193.178637:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144781 expref: 20 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098193.178666:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787098193.178672:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098193.178677:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787098193.178691:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098193.178697:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787098193.178712:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098193.178719:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0144773 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b014477a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098193.178731:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098193.178732:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098193.178734:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098193.178754:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077743744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787098193.178783:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098193.179072:0:11178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787098193.179085:0:11178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1787098193.179194:0:11678:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787098193.179235:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077742848:0@lo:104: 00000100:00100000:1.0:1787098193.179249:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077742976:0@lo:104: 00000100:00100000:1.0:1787098193.179262:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077743104:0@lo:104: 00000100:00100000:1.0:1787098193.179361:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077743744 00000100:00100000:1.0:1787098193.179368:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077743744 00010000:00010000:1.0:1787098193.179399:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144773 expref: 21 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098193.179423:0:11178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787098193.179437:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787098193.179446:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d721fa99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af6522d0-d61c-40bd-bd34-bb282ba82d15+21:3309:x1873908077743744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787098193.179462:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098193.179469:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0144773 expref: 21 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.180718:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144765 expref: 21 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.180751:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227413800/0xb1d871f9b014476c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144765 expref: 21 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.180767:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098193.180832:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af6522d0-d61c-40bd-bd34-bb282ba82d15+20:3311:x1873908077743616:12345-0@lo:103:ldlm_bl.0 Request processed in 2330us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098193.180843:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787098193.180916:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b1ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077743616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098193.181136:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077743232:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098193.181167:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144781 expref: 19 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.181239:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0144788 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144781 expref: 19 pid: 5836 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.181249:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098193.181843:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:3311:x1873908077743488:12345-0@lo:103:ldlm_bl.0 Request processed in 3230us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098193.181867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787098193.181916:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077743488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787098193.184484:0:11678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1873908077743360:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098193.184532:0:11678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.184803:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0144773 expref: 17 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.184837:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200030600/0xb1d871f9b014477a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0144773 expref: 17 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098193.184870:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098193.184976:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d721fa99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3309:x1873908077743744:12345-0@lo:103:ldlm_bl.0 Request processed in 5529us (6189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098193.184992:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787098193.185025:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077743744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787098193.185638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098193.185676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098193.185744:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059885824 00000100:00100000:3.0:1787098193.185754:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059885824 00010000:00010000:3.0:1787098193.185801:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528741e expref: 13 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098193.185837:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059885952 00000100:00100000:3.0:1787098193.185841:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059885952 00010000:00010000:3.0:1787098193.185859:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287417 expref: 14 pid: 5838 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098193.185888:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1787098193.185900:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+14:2373:x1873908059885824:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098193.185917:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098193.185924:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528741e expref: 14 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.185946:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528741e expref: 14 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.185964:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200030400/0xb1d871f9b014475e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528741e expref: 14 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.185989:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098193.186046:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059885824:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 147us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098193.186055:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1787098193.186081:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1787098193.186158:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:2373:x1873908059885952:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098193.186168:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098193.186173:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287417 expref: 12 pid: 5838 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186183:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287417 expref: 12 pid: 5838 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186207:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6800/0xb1d871f9b0144757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287417 expref: 12 pid: 5838 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186226:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186235:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186254:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186261:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186269:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186301:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186310:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412400 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098193.186314:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186330:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186348:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098193.186360:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098193.186384:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:2373:x1873908059885952:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 228us (707us total) trans 0 rc 0/0 00010000:00010000:2.0:1787098193.186824:0:11678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.186862:0:11678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098193.186870:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227412400/0xb1d871f9b01448bc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098193.196593:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00010000:00010000:3.0:1787098193.295502:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787098193.592466:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 10000000:01000000:1.0:1787098194.256200:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787098194.256211:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7104c23800 from 7 10000000:01000000:1.0:1787098194.256217:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787098194.256305:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098194.256329:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098194.256342:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098194.256378:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077743872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787098194.256481:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098194.256635:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787098194.258642:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077743872 00000100:00100000:0.0:1787098194.258661:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077743872 00000100:00100000:0.0:1787098194.258757:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787098194.258770:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:5841:x1873908077743872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098194.258792:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098194.258819:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208695c00/0xb1d871f9b01448ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01448c3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.258928:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208695c00/0xb1d871f9b01448ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01448c3 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.258943:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208695c00/0xb1d871f9b01448ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01448c3 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.258955:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695c00, rc 0) 00000100:00100000:0.0:1787098194.259070:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077743872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 302us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.259077:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787098194.259190:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077743872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098194.259212:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098194.259243:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098194.259373:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098194.259413:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098194.259459:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787098194.259520:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077744000 00000100:00100000:0.0:1787098194.259525:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077744000 00000100:00100000:0.0:1787098194.259597:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787098194.259606:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077744000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098194.259961:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077744000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.259975:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787098194.260047:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098194.260081:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098194.260125:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098194.260772:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787098194.260856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077744128 00000100:00100000:2.0:1787098194.260864:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077744128 00000100:00100000:2.0:1787098194.260906:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787098194.260928:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077744128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098194.261196:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077744128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 281us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098194.261205:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787098194.261404:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098194.261808:0:11694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11694:1873908077744256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098194.261859:0:11694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098194.261939:0:11694:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73300 going to sleep for 11 seconds 00000100:00100000:1.0:1787098194.261976:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077744256 00000100:00100000:1.0:1787098194.261982:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077744256 00000100:00100000:1.0:1787098194.262061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787098194.262070:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:11694:x1873908077744256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098194.262255:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:11694:x1873908077744256:12345-0@lo:502:llog_process_th.0 Request processed in 186us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098194.262263:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787098194.262360:0:11694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11694:1873908077744256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787098194.262387:0:11694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098194.262400:0:11694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098194.262402:0:11694:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787098194.262409:0:11694:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d7104c23800 00000020:00000080:2.0:1787098194.262412:0:11694:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787098194.262524:0:11694:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11694:1873908077744384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098194.262560:0:11694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098194.265670:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077744384 00000100:00100000:0.0:1787098194.265690:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077744384 00000100:00100000:2.0:1787098194.265750:0:11694:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73300 going to sleep for 11 seconds 00000100:00100000:0.0:1787098194.265766:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787098194.265776:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:11694:x1873908077744384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098194.266123:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:11694:x1873908077744384:12345-0@lo:502:llog_process_th.0 Request processed in 347us (3561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.266131:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787098194.266775:0:11694:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11694:1873908077744384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787098194.266823:0:11694:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098194.266833:0:11694:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098194.266836:0:11694:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787098194.266840:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787098194.267020:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787098194.267045:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787098194.267057:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.267071:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098194.267083:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787098194.267087:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7227639800 from 7 10000000:01000000:0.0:1787098194.267089:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787098194.269160:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.269182:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.269213:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098194.271617:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787098194.271718:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098194.271776:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098194.273858:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077744512 00000100:00100000:2.0:1787098194.273876:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077744512 00000100:00100000:2.0:1787098194.273966:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787098194.273978:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:5841:x1873908077744512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098194.274002:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098194.274027:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227622000/0xb1d871f9b01448d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01448d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098194.274064:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227622000/0xb1d871f9b01448d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01448d1 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098194.274076:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227622000/0xb1d871f9b01448d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01448d1 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098194.274095:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622000, rc 0) 00000100:00100000:2.0:1787098194.274192:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077744512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098194.274200:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787098194.274763:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098194.274788:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.274800:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098194.274892:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098194.274952:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098194.275000:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098194.277924:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077744640 00000100:00100000:1.0:1787098194.277942:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077744640 00000100:00100000:1.0:1787098194.278023:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787098194.278036:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077744640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098194.278491:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077744640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 455us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098194.278512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787098194.278694:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098194.278766:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787098194.278820:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098194.278858:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098194.278963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077744768 00000100:00100000:2.0:1787098194.278969:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077744768 00000100:00100000:2.0:1787098194.279011:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787098194.279019:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077744768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098194.279211:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077744768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098194.279219:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787098194.279394:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077744768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098194.279954:0:11697:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11697:1873908077744896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098194.280016:0:11697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098194.280054:0:11697:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abf600 going to sleep for 11 seconds 00000100:00100000:2.0:1787098194.280108:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077744896 00000100:00100000:2.0:1787098194.280114:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077744896 00000100:00100000:2.0:1787098194.280186:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787098194.280195:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:11697:x1873908077744896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098194.280420:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:11697:x1873908077744896:12345-0@lo:502:llog_process_th.0 Request processed in 225us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098194.280428:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787098194.280517:0:11697:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11697:1873908077744896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787098194.280548:0:11697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098194.280561:0:11697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098194.280564:0:11697:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787098194.280573:0:11697:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d7227639800 00000020:00000080:1.0:1787098194.280576:0:11697:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787098194.280671:0:11697:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11697:1873908077745024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098194.280709:0:11697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098194.281049:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077745024 00000100:00100000:0.0:1787098194.281055:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077745024 00000100:00100000:0.0:1787098194.281090:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787098194.281098:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:11697:x1873908077745024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098194.281735:0:11697:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abf600 going to sleep for 11 seconds 00000100:00100000:0.0:1787098194.281987:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:11697:x1873908077745024:12345-0@lo:502:llog_process_th.0 Request processed in 888us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.281996:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787098194.282330:0:11697:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11697:1873908077745024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787098194.282367:0:11697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098194.282376:0:11697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098194.282379:0:11697:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787098194.282389:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787098194.282576:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787098194.282606:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787098194.282618:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.282631:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098194.282644:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787098194.282647:0:5841:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d72079cb000 from 7 10000000:01000000:0.0:1787098194.282651:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787098194.282689:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.282697:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.282707:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098194.282728:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077745152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787098194.282774:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098194.282814:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787098194.283142:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077745152 00000100:00100000:3.0:1787098194.283150:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077745152 00000100:00100000:3.0:1787098194.283306:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787098194.283319:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:5841:x1873908077745152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098194.283335:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098194.283352:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6800/0xb1d871f9b01448e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01448df expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098194.283378:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6800/0xb1d871f9b01448e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01448df expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098194.283390:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6800/0xb1d871f9b01448e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01448df expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098194.283405:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6800, rc 0) 00000100:00100000:3.0:1787098194.283455:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077745152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098194.283622:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077745152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098194.283641:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098194.283652:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098194.283733:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077745280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098194.283770:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098194.283814:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73000 going to sleep for 11 seconds 00000100:00100000:3.0:1787098194.283872:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787098194.283921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077745280 00000100:00100000:3.0:1787098194.283926:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077745280 00000100:00100000:3.0:1787098194.283956:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787098194.283963:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077745280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098194.284814:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077745280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 847us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098194.284824:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787098194.284983:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077745280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098194.285026:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077745408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098194.285076:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098194.285135:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73000 going to sleep for 11 seconds 00000100:00100000:3.0:1787098194.285171:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077745408 00000100:00100000:3.0:1787098194.285175:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077745408 00000100:00100000:3.0:1787098194.285428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787098194.285435:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077745408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098194.285712:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:5841:x1873908077745408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098194.285719:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000040:00080000:1.0:1787098194.285726:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787098194.285770:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af6522d0-d61c-40bd-bd34-bb282ba82d15:5841:1873908077745408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787098194.288461:0:11699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11699:1873908077745536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098194.288572:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098194.288633:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077745536 00000100:00100000:0.0:1787098194.288642:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077745536 00000100:00100000:0.0:1787098194.288701:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787098194.288855:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:11699:x1873908077745536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098194.289172:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:11699:x1873908077745536:12345-0@lo:502:llog_process_th.0 Request processed in 459us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.289181:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787098194.289250:0:11699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787098194.289277:0:11699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11699:1873908077745536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787098194.289348:0:11699:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787098194.289361:0:11699:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098194.289364:0:11699:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787098194.289370:0:11699:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d72079cb000 00000020:00000080:0.0:1787098194.289374:0:11699:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787098194.289456:0:11699:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11699:1873908077745664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098194.289498:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098194.289527:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077745664 00000100:00100000:0.0:1787098194.289532:0:11699:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787098194.289533:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077745664 00000100:00100000:3.0:1787098194.289579:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787098194.289589:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:11699:x1873908077745664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098194.291984:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:11699:x1873908077745664:12345-0@lo:502:llog_process_th.0 Request processed in 2382us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098194.292003:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787098194.292240:0:11699:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e09880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af6522d0-d61c-40bd-bd34-bb282ba82d15:11699:1873908077745664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787098194.292303:0:11699:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787098194.292313:0:11699:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787098194.292316:0:11699:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787098194.292321:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787098194.292523:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787098194.292555:0:5841:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787098194.292570:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098194.292591:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098194.319804:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098194.457780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098194.459472:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059886080 00000100:00100000:0.0:1787098194.459492:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059886080 00000100:00100000:0.0:1787098194.459654:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 258 00000100:00100000:0.0:1787098194.459668:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:5612:x1873908059886080:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098194.459692:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098194.459736:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208694600/0xb1d871f9b01448ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e528746b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.459777:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208694600/0xb1d871f9b01448ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528746b expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.459791:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208694600/0xb1d871f9b01448ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528746b expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098194.459803:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694600, rc 0) 00000100:00100000:0.0:1787098194.459903:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204973c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059886080:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 238us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.459923:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 258 00000100:00100000:2.0:1787098194.466638:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098194.466757:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059886208 00000100:00100000:3.0:1787098194.466790:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059886208 00000100:00100000:3.0:1787098194.466872:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 259 00000100:00100000:3.0:1787098194.466883:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059886208:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098194.467348:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059886208:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 395us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098194.467358:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 259 00000100:00100000:1.0:1787098194.471613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098194.471733:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059886336 00000100:00100000:0.0:1787098194.471747:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059886336 00000100:00100000:0.0:1787098194.471818:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 260 00000100:00100000:0.0:1787098194.471830:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059886336:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787098194.473156:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059886336:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 1317us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.473173:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 260 00000100:00100000:1.0:1787098194.477804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098194.478427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059886464 00000100:00100000:0.0:1787098194.478443:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059886464 00000100:00100000:0.0:1787098194.478520:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 261 00000100:00100000:0.0:1787098194.478532:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:9991:x1873908059886464:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098194.479006:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:9991:x1873908059886464:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 473us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.479026:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 261 00000100:00100000:2.0:1787098194.482464:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098194.482599:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059886592 00000100:00100000:0.0:1787098194.482612:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059886592 00000100:00100000:0.0:1787098194.482759:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 262 00000100:00100000:0.0:1787098194.482772:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:9991:x1873908059886592:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098194.483807:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:9991:x1873908059886592:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 1026us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.483820:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 262 00000100:00100000:1.0:1787098194.490712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098194.491429:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059886720 00000100:00100000:3.0:1787098194.491444:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059886720 00000100:00100000:3.0:1787098194.491620:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 263 00000100:00100000:3.0:1787098194.491645:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:5612:x1873908059886720:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098194.491668:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098194.491692:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01448f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287472 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098194.491731:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01448f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287472 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098194.491744:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01448f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287472 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098194.491754:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7200, rc 0) 00000100:00100000:3.0:1787098194.491882:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059886720:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 252us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098194.491890:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 263 00000100:00100000:1.0:1787098194.495509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098194.495794:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059886848 00000100:00100000:0.0:1787098194.495806:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059886848 00000100:00100000:0.0:1787098194.495885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 264 00000100:00100000:0.0:1787098194.495897:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059886848:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098194.496537:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059886848:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 639us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.496548:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 264 00000100:00100000:2.0:1787098194.501252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098194.501511:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059886976 00000100:00100000:3.0:1787098194.501525:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059886976 00000100:00100000:3.0:1787098194.501598:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 265 00000100:00100000:3.0:1787098194.501609:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059886976:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098194.502365:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:5612:x1873908059886976:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 750us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098194.502375:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 265 00000100:00100000:1.0:1787098194.510034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098194.510566:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059887104 00000100:00100000:0.0:1787098194.510581:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059887104 00000100:00100000:0.0:1787098194.510653:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 266 00000100:00100000:0.0:1787098194.510665:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:9994:x1873908059887104:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098194.511012:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:9994:x1873908059887104:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 348us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.511029:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 266 00000100:00100000:1.0:1787098194.519932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098194.520150:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059887232 00000100:00100000:3.0:1787098194.520163:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059887232 00000100:00100000:3.0:1787098194.520234:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 267 00000100:00100000:3.0:1787098194.520246:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:9994:x1873908059887232:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787098194.521812:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:9994:x1873908059887232:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 1557us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098194.521828:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 267 00000100:00100000:2.0:1787098194.965040:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098194.965148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098194.966783:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098194.966873:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059887488 00000100:00100000:3.0:1787098194.966885:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059887488 00000100:00100000:3.0:1787098194.966967:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:3.0:1787098194.966978:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059887488:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098194.967053:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059887488:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 77us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098194.967061:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00080000:2.0:1787098194.967803:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098194.967866:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059887360 00000100:00100000:0.0:1787098194.967873:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059887360 00000100:00100000:0.0:1787098194.967941:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059887616 00000100:00100000:0.0:1787098194.967945:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059887616 00000100:00100000:0.0:1787098194.967971:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:0.0:1787098194.967988:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059887360:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098194.968037:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059887360:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 50us (3007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.968044:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:0.0:1787098194.968058:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1787098194.968064:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2376:x1873908059887616:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098194.968089:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2376:x1873908059887616:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (2942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098194.968095:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00080000:2.0:1787098194.968269:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098195.088951:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077745792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098195.089419:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098195.089657:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077745792 00000100:00100000:0.0:1787098195.089667:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077745792 00000100:00100000:0.0:1787098195.089741:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787098195.089751:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077745792:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787098195.089769:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787098195.089977:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098195.090142:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077745792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 392us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098195.090150:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787098195.090217:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787098195.090223:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7104f90380, transno 4294967300 00000100:00100000:3.0:1787098195.090312:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077745792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787098195.344103:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787098195.345452:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787098196.369990:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098197.396153:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098197.647693:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077746048:0@lo:400:kworker.0 00000100:00100000:3.0:1787098197.647754:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077745920:0@lo:400:kworker.0 00000100:00100000:0.0:1787098197.647764:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098197.647830:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077746176:0@lo:400:kworker.0 00000100:00100000:2.0:1787098197.647958:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077746304:0@lo:400:kworker.0 00000100:00100000:3.0:1787098197.647975:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098197.648019:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077746560:0@lo:400:kworker.0 00000100:00100000:0.0:1787098197.648057:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098197.648393:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077746432:0@lo:400:kworker.0 00000100:00100000:3.0:1787098197.648426:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098197.650133:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098197.650446:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077746560 00000100:00100000:0.0:1787098197.650457:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077746560 00000100:00100000:0.0:1787098197.650523:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787098197.650546:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077746560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098197.650609:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077746560:12345-0@lo:400:kworker.0 Request processed in 66us (2551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098197.651094:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077746048 00000100:00100000:1.0:1787098197.651102:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077746048 00000100:00100000:1.0:1787098197.651136:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077746432 00000100:00100000:1.0:1787098197.651139:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077746432 00000100:00100000:1.0:1787098197.651155:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077746176 00000100:00100000:1.0:1787098197.651158:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077746176 00000100:00100000:1.0:1787098197.651174:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787098197.651181:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077746048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098197.651253:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077745920 00000100:00100000:3.0:1787098197.651271:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077745920 00000100:00100000:3.0:1787098197.651325:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787098197.651330:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077746048:12345-0@lo:400:kworker.0 Request processed in 147us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098197.651339:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077745920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098197.651343:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787098197.651367:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787098197.651376:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077746432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098197.651396:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077745920:12345-0@lo:400:kworker.0 Request processed in 61us (3420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098197.651404:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787098197.651459:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077746432:12345-0@lo:400:kworker.0 Request processed in 84us (3032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098197.651467:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787098197.651477:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077746432:0@lo:400:kworker.0 00000100:00100000:1.0:1787098197.651489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787098197.651494:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077745920:0@lo:400:kworker.0 00000100:00100000:0.0:1787098197.651498:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787098197.651504:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077746176:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787098197.651534:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098197.651540:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787098197.651541:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787098197.651547:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077746176:12345-0@lo:400:kworker.0 Request processed in 48us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098197.651554:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787098197.651571:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077746304 00000100:00100000:0.0:1787098197.651577:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077746304 00010000:00080000:3.0:1787098197.651578:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723b0e1180 x1873908077746560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098197.651591:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077746560:0@lo:400:kworker.0 00000100:00100000:1.0:1787098197.651599:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077746176:0@lo:400:kworker.0 00000100:00100000:3.0:1787098197.651612:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077746048:0@lo:400:kworker.0 00000100:00100000:0.0:1787098197.651618:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787098197.651627:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077746304:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787098197.652046:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098197.657406:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077746304:12345-0@lo:400:kworker.0 Request processed in 5769us (5857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098197.657423:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787098197.657583:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077746304:0@lo:400:kworker.0 00000100:00100000:2.0:1787098198.161906:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077746688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098198.161985:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098198.162133:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077746688 00000100:00100000:3.0:1787098198.162141:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077746688 00000100:00100000:3.0:1787098198.162199:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787098198.162209:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077746688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787098198.162246:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098198.174674:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077746688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12455us (12677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098198.174692:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787098198.174819:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e08380 x1873908077746688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098198.174855:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077746688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787098198.415589:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098199.439562:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098200.087849:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098200.087905:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098200.088007:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059887744 00000100:00100000:3.0:1787098200.088020:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059887744 00000100:00100000:3.0:1787098200.088107:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 269 00000100:00100000:3.0:1787098200.088121:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059887744:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098200.088237:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059887744:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 118us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098200.088246:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 269 00000100:00100000:2.0:1787098200.088852:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098200.088996:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059888000 00000100:00100000:0.0:1787098200.089003:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059888000 00000100:00100000:0.0:1787098200.089075:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1787098200.089085:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059888000:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098200.089142:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059888000:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 60us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098200.089150:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00080000:0.0:1787098200.089171:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098200.089320:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059887872 00000100:00100000:1.0:1787098200.089325:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059887872 00000100:00100000:1.0:1787098200.089380:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:1.0:1787098200.089398:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059887872:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098200.089442:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059887872:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 46us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098200.089449:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:2.0:1787098200.089708:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00080000:0.0:1787098200.089902:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098200.091660:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059888128 00000100:00100000:1.0:1787098200.091679:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059888128 00000100:00100000:1.0:1787098200.091808:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:1.0:1787098200.091823:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059888128:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098200.092030:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059888128:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 210us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098200.092039:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00080000:0.0:1787098200.092357:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098200.209500:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787098200.217248:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077746816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098200.217395:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098200.217485:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077746816 00000100:00100000:0.0:1787098200.217496:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077746816 00000100:00100000:0.0:1787098200.217600:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787098200.217613:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077746816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098200.217691:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098200.217769:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077746816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098200.217778:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787098200.217859:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077746816:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787098200.217881:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787098200.465317:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098201.487743:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098202.515716:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098202.767582:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077747200:0@lo:400:kworker.0 00000100:00100000:1.0:1787098202.767684:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098202.767710:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077746944:0@lo:400:kworker.0 00000100:00100000:3.0:1787098202.767773:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098202.767804:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098202.767808:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077747456:0@lo:400:kworker.0 00000100:00100000:1.0:1787098202.767815:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077747328:0@lo:400:kworker.0 00000100:00100000:3.0:1787098202.767837:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098202.767860:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098202.767861:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787098202.767868:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077747072:0@lo:400:kworker.0 00000100:00100000:3.0:1787098202.767901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098202.767910:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077747328 00000100:00100000:3.0:1787098202.767922:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077747584:0@lo:400:kworker.0 00000100:00100000:1.0:1787098202.767934:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077747328 00000100:00100000:3.0:1787098202.767946:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098202.768007:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077747584 00000100:00100000:1.0:1787098202.768012:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077747584 00000100:00100000:1.0:1787098202.768048:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787098202.768062:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077747328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098202.768076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077746944 00000100:00100000:3.0:1787098202.768081:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077746944 00000100:00100000:3.0:1787098202.768117:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787098202.768126:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077746944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098202.768168:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077747328:12345-0@lo:400:kworker.0 Request processed in 109us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098202.768178:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077746944:12345-0@lo:400:kworker.0 Request processed in 53us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098202.768179:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787098202.768190:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787098202.768207:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787098202.768218:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077747584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098202.768253:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077746944:0@lo:400:kworker.0 00000100:00100000:1.0:1787098202.768257:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077747584:12345-0@lo:400:kworker.0 Request processed in 42us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098202.768268:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787098202.768313:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098202.768319:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787098202.768325:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72417d9180 x1873908077747584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098202.768337:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077747200 00000100:00100000:3.0:1787098202.768338:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077747584:0@lo:400:kworker.0 00000100:00100000:1.0:1787098202.768344:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077747200 00000100:00100000:1.0:1787098202.768444:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077747456 00000100:00100000:1.0:1787098202.768448:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077747456 00000100:00100000:0.0:1787098202.768574:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077747328:0@lo:400:kworker.0 00000100:00080000:0.0:1787098202.768594:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098202.768675:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077747072 00000100:00100000:3.0:1787098202.768680:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077747072 00000100:00100000:3.0:1787098202.768700:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787098202.768706:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077747200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098202.768745:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077747200:12345-0@lo:400:kworker.0 Request processed in 39us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098202.768763:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787098202.768775:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787098202.768781:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077747456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098202.768810:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077747456:12345-0@lo:400:kworker.0 Request processed in 30us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098202.768816:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787098202.768826:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787098202.768831:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077747072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098202.768852:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077747072:12345-0@lo:400:kworker.0 Request processed in 22us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098202.768857:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787098202.768883:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077747072:0@lo:400:kworker.0 00000100:00100000:3.0:1787098202.768893:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077747456:0@lo:400:kworker.0 00000100:00100000:1.0:1787098202.769265:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077747200:0@lo:400:kworker.0 00000100:00100000:1.0:1787098203.280011:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077747712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098203.280113:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098203.280406:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077747712 00000100:00100000:2.0:1787098203.280417:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077747712 00000100:00100000:2.0:1787098203.280489:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787098203.280501:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077747712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787098203.280552:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098203.280614:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077747712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098203.280622:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787098203.280804:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72417d8e00 x1873908077747712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098203.280840:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077747712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787098203.537466:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098204.559835:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098205.208432:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098205.208489:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098205.208538:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098205.208578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098205.208638:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059888512 00000100:00100000:0.0:1787098205.208715:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059888256 00000100:00100000:0.0:1787098205.208735:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059888256 00000100:00100000:3.0:1787098205.208763:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059888384 00000100:00100000:3.0:1787098205.208774:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059888384 00000100:00100000:0.0:1787098205.208821:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 271 00000100:00100000:0.0:1787098205.208834:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059888256:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098205.208868:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059888640 00000100:00100000:3.0:1787098205.208873:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059888640 00000100:00100000:3.0:1787098205.208908:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:3.0:1787098205.208920:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059888384:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098205.208931:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059888256:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098205.208942:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 271 00000100:00100000:3.0:1787098205.208996:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059888384:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 76us (577us total) trans 0 rc 0/0 00000100:00080000:0.0:1787098205.209002:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098205.209007:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:0.0:1787098205.209031:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:0.0:1787098205.209045:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2374:x1873908059888640:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098205.209165:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059888512 00000100:00100000:1.0:1787098205.209233:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1787098205.209242:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059888512:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098205.209310:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059888512:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 68us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098205.209318:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00080000:3.0:1787098205.209574:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098205.209798:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2374:x1873908059888640:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 753us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098205.209809:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:1.0:1787098205.328445:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787098205.328479:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077747840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098205.328577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098205.328791:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077747840 00000100:00100000:2.0:1787098205.328819:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077747840 00000100:00100000:2.0:1787098205.328917:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787098205.328930:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077747840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787098205.328976:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098205.329034:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077747840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098205.329042:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787098205.329082:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077747840:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787098205.329134:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787098205.583608:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787098205.584359:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787098206.607503:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098207.631986:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098207.887851:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077748352:0@lo:400:kworker.0 00000100:00100000:0.0:1787098207.887966:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098207.888122:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077748096:0@lo:400:kworker.0 00000100:00100000:1.0:1787098207.888199:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077747968:0@lo:400:kworker.0 00000100:00100000:3.0:1787098207.888333:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077748352 00000100:00100000:3.0:1787098207.888345:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077748352 00000100:00100000:3.0:1787098207.888426:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787098207.888440:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077748352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098207.888586:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787098207.888615:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077748224:0@lo:400:kworker.0 00000100:00100000:2.0:1787098207.889535:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098207.889584:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077748608:0@lo:400:kworker.0 00000100:00100000:2.0:1787098207.889624:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098207.889709:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077748096 00000100:00100000:2.0:1787098207.889716:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077748096 00000100:00100000:2.0:1787098207.889768:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787098207.889788:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077748096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098207.889841:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077748096:12345-0@lo:400:kworker.0 Request processed in 64us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098207.889850:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787098207.889881:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077748608 00000100:00100000:2.0:1787098207.889885:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077748608 00000100:00100000:2.0:1787098207.889932:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787098207.889939:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077748608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098207.889985:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077748608:12345-0@lo:400:kworker.0 Request processed in 47us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098207.889992:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787098207.890048:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077748096:0@lo:400:kworker.0 00010000:00080000:2.0:1787098207.890077:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7203e09500 x1873908077748608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098207.890088:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077748608:0@lo:400:kworker.0 00000100:00080000:2.0:1787098207.890471:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787098207.890478:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098207.893449:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098207.893538:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077748480:0@lo:400:kworker.0 00000100:00100000:1.0:1787098207.893598:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098207.893794:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077747968 00000100:00100000:2.0:1787098207.893806:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077747968 00000100:00100000:2.0:1787098207.893875:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787098207.893886:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077747968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098207.893975:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077747968:12345-0@lo:400:kworker.0 Request processed in 91us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098207.893983:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787098207.894537:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077748480 00000100:00100000:1.0:1787098207.894548:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077748480 00000100:00100000:1.0:1787098207.894614:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787098207.894623:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077748480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098207.894771:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077748480:12345-0@lo:400:kworker.0 Request processed in 148us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098207.894778:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787098207.894836:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077747968:0@lo:400:kworker.0 00000100:00100000:1.0:1787098207.894852:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077748480:0@lo:400:kworker.0 00000100:00100000:3.0:1787098207.896818:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077748352:12345-0@lo:400:kworker.0 Request processed in 8369us (8837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098207.896838:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787098207.896992:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098207.897614:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098207.899349:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077748224 00000100:00100000:2.0:1787098207.899369:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077748224 00000100:00100000:2.0:1787098207.899487:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787098207.899500:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077748224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098207.899622:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077748224:12345-0@lo:400:kworker.0 Request processed in 123us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098207.899631:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1787098207.899797:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098207.900971:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077748224:0@lo:400:kworker.0 00000100:00100000:0.0:1787098207.900994:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077748352:0@lo:400:kworker.0 00000100:00100000:0.0:1787098208.403333:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077748736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787098208.403454:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098208.404159:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077748736 00000100:00100000:1.0:1787098208.404171:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077748736 00000100:00100000:1.0:1787098208.404241:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787098208.404253:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077748736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098208.404333:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098208.404423:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077748736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098208.404431:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787098208.404721:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72417d9500 x1873908077748736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098208.404744:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077748736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787098208.657111:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098209.680575:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098210.326626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098210.326683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098210.326788:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059888768 00000100:00100000:3.0:1787098210.326803:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059888768 00000100:00100000:3.0:1787098210.326879:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 273 00000100:00100000:3.0:1787098210.326893:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059888768:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098210.327007:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059888768:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 116us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098210.327016:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 273 00000100:00100000:1.0:1787098210.327332:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059888896 00000100:00100000:1.0:1787098210.327339:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059888896 00000100:00100000:1.0:1787098210.327395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:1.0:1787098210.327404:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059888896:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098210.327455:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059888896:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 53us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098210.327463:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00080000:3.0:1787098210.327691:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098210.344074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098210.344123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098210.344222:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059889152 00000100:00100000:3.0:1787098210.344232:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059889152 00000100:00100000:3.0:1787098210.344359:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:3.0:1787098210.344369:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059889152:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098210.344449:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059889152:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 81us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098210.344457:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00080000:2.0:1787098210.344715:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098210.346342:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059889024 00000100:00100000:1.0:1787098210.346362:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059889024 00000100:00100000:1.0:1787098210.346531:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00080000:2.0:1787098210.346542:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098210.346545:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2372:x1873908059889024:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:1.0:1787098210.346588:0:6702:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144830 00000100:00080000:1.0:1787098210.346610:0:6702:0:(import.c:65:import_set_state_nolock()) ffff8d710499a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787098210.346668:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787098210.347052:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+2:2372:x1873908059889024:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 509us (2987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098210.347062:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00010000:00010000:0.0:1787098210.347610:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098210.449452:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787098210.454310:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077748864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098210.454392:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098210.456220:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077748864 00000100:00100000:0.0:1787098210.456236:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077748864 00000100:00100000:0.0:1787098210.456339:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787098210.456348:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077748864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098210.456386:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787098210.456499:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098210.459342:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077748864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2985us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098210.459358:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787098210.461510:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077748864:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787098210.705071:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098211.729643:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098212.752980:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098213.007650:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077749248:0@lo:400:kworker.0 00000100:00100000:3.0:1787098213.007669:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077748992:0@lo:400:kworker.0 00000100:00100000:0.0:1787098213.007892:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077749120:0@lo:400:kworker.0 00000100:00100000:3.0:1787098213.008735:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098213.008856:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077749504:0@lo:400:kworker.0 00000100:00100000:3.0:1787098213.008912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098213.008987:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077749376:0@lo:400:kworker.0 00000100:00100000:3.0:1787098213.009022:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098213.009066:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077749376 00000100:00100000:3.0:1787098213.009085:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077749376 00000100:00100000:3.0:1787098213.009151:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787098213.009162:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077749376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098213.009232:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077749376:12345-0@lo:400:kworker.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098213.009240:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787098213.009319:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077749376:0@lo:400:kworker.0 00000100:00080000:3.0:1787098213.009348:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787098213.009367:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077749504 00000100:00100000:3.0:1787098213.009370:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077749504 00000100:00100000:3.0:1787098213.009404:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787098213.009743:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077749504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098213.009788:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077749504:12345-0@lo:400:kworker.0 Request processed in 48us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098213.009795:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1787098213.009813:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098213.009832:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077749504:0@lo:400:kworker.0 00000100:00100000:2.0:1787098213.010750:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077748992 00000100:00100000:2.0:1787098213.010760:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077748992 00000100:00100000:1.0:1787098213.010909:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098213.010969:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077749248 00000100:00100000:1.0:1787098213.010974:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077749248 00000100:00100000:1.0:1787098213.011011:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787098213.011020:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077749248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098213.011149:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787098213.011160:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077748992:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787098213.011407:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098213.011634:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077749248:12345-0@lo:400:kworker.0 Request processed in 612us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098213.011643:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787098213.011687:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077749248:0@lo:400:kworker.0 00000100:00100000:2.0:1787098213.011775:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077748992:12345-0@lo:400:kworker.0 Request processed in 617us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098213.011783:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787098213.011849:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077748992:0@lo:400:kworker.0 00000100:00100000:0.0:1787098213.012363:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098213.012416:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077749632:0@lo:400:kworker.0 00000100:00100000:0.0:1787098213.012453:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098213.012517:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077749120 00000100:00100000:1.0:1787098213.012523:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077749120 00000100:00100000:1.0:1787098213.012585:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787098213.012597:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077749120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098213.012663:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077749120:12345-0@lo:400:kworker.0 Request processed in 68us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098213.012671:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787098213.012730:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077749120:0@lo:400:kworker.0 00000100:00100000:3.0:1787098213.015776:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077749632 00000100:00100000:3.0:1787098213.015792:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077749632 00000100:00100000:3.0:1787098213.015876:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787098213.015887:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077749632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098213.015999:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077749632:12345-0@lo:400:kworker.0 Request processed in 114us (3544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098213.016006:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787098213.016063:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7241c5ea00 x1873908077749632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098213.016077:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077749632:0@lo:400:kworker.0 00000100:00080000:2.0:1787098213.016678:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787098213.519708:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787098213.519730:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077749760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098213.519800:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098213.519862:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077749760 00000100:00100000:3.0:1787098213.519870:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077749760 00000100:00100000:3.0:1787098213.519911:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787098213.519920:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077749760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787098213.519977:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098213.520023:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077749760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098213.520031:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1787098213.520070:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72417dbb80 x1873908077749760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098213.520089:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077749760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787098213.786401:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787098214.098867:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:2.0:1787098214.098876:0:6727:0:(genops.c:906:class_export_put()) final put ffff8d710499f800/530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:0.0:1787098214.098945:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d710499f800/530d6019-f48b-45e0-97e8-95fbd128e52b for lustre-OST0000 00000020:00000080:0.0:1787098214.099160:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d710499a800 for lustre-OST0000 00010000:00010000:3.0:1787098214.799550:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098215.447164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098215.447724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098215.447804:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059889280 00000100:00100000:0.0:1787098215.447814:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059889280 00000100:00100000:0.0:1787098215.447895:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 275 00000100:00100000:0.0:1787098215.447905:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059889280:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098215.447985:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059889280:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098215.447993:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 275 00000100:00100000:3.0:1787098215.449312:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059889408 00000100:00100000:3.0:1787098215.449323:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059889408 00000100:00080000:2.0:1787098215.449914:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098215.449967:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:0.0:1787098215.449979:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059889408:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098215.450060:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059889408:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 83us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098215.450067:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:2.0:1787098215.458378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098215.458515:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059889536 00000100:00100000:1.0:1787098215.458526:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059889536 00000100:00100000:1.0:1787098215.458605:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:1.0:1787098215.458615:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059889536:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098215.458713:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2375:x1873908059889536:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 100us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098215.458722:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00080000:2.0:1787098215.458781:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098215.568949:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098215.568974:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077749888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098215.569055:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098215.569478:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077749888 00000100:00100000:1.0:1787098215.569487:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077749888 00000100:00100000:1.0:1787098215.569566:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787098215.569576:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077749888:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787098215.569725:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787098215.569804:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098215.569873:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077749888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 298us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098215.569881:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787098215.569975:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077749888:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787098215.825527:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787098215.826888:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787098216.645054:0:11863:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:10:15 (1787098215) 00010000:00010000:2.0:1787098216.853728:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098217.871731:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098218.127645:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077750400:0@lo:400:kworker.0 00000100:00100000:2.0:1787098218.127721:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098218.127786:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787098218.127793:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077750272:0@lo:400:kworker.0 00000100:00100000:2.0:1787098218.127822:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098218.127856:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077750400 00000100:00100000:2.0:1787098218.127863:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077750400 00000100:00100000:2.0:1787098218.127922:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787098218.127932:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077750400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098218.128012:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077750400:12345-0@lo:400:kworker.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098218.128020:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787098218.128045:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077750272 00000100:00100000:2.0:1787098218.128048:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077750272 00000100:00100000:2.0:1787098218.128077:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787098218.128084:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077750272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098218.128116:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077750272:12345-0@lo:400:kworker.0 Request processed in 32us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098218.128123:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1787098218.128140:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787098218.128143:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098218.128174:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077750272:0@lo:400:kworker.0 00000100:00100000:2.0:1787098218.128185:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077750400:0@lo:400:kworker.0 00000100:00100000:1.0:1787098218.128598:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077750144:0@lo:400:kworker.0 00000100:00100000:1.0:1787098218.128636:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098218.128667:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077750656:0@lo:400:kworker.0 00000100:00100000:1.0:1787098218.128689:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098218.128716:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787098218.128723:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077750016:0@lo:400:kworker.0 00000100:00100000:1.0:1787098218.128750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098218.128770:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077750528:0@lo:400:kworker.0 00000100:00100000:1.0:1787098218.128791:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098218.128816:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077750656 00000100:00100000:1.0:1787098218.128820:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077750656 00000100:00100000:1.0:1787098218.128854:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787098218.128861:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077750656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098218.128899:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077750656:12345-0@lo:400:kworker.0 Request processed in 38us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098218.128914:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787098218.128932:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077750144 00000100:00100000:1.0:1787098218.128935:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077750144 00000100:00100000:1.0:1787098218.129025:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077750528 00000100:00100000:1.0:1787098218.129028:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077750528 00000100:00100000:1.0:1787098218.129048:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787098218.129053:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077750144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098218.129085:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077750144:12345-0@lo:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098218.129091:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787098218.129104:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787098218.129110:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077750528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098218.129136:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077750528:12345-0@lo:400:kworker.0 Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098218.129142:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787098218.129175:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077750528:0@lo:400:kworker.0 00000100:00100000:1.0:1787098218.129184:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077750144:0@lo:400:kworker.0 00010000:00080000:1.0:1787098218.129195:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72417db800 x1873908077750656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787098234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098218.129205:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077750656:0@lo:400:kworker.0 00000100:00100000:2.0:1787098218.130347:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077750016 00000100:00100000:2.0:1787098218.130358:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077750016 00000100:00100000:2.0:1787098218.130413:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787098218.130421:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077750016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098218.130501:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077750016:12345-0@lo:400:kworker.0 Request processed in 80us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098218.130508:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:2.0:1787098218.130546:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787098218.130552:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787098218.131040:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077750016:0@lo:400:kworker.0 00000100:00100000:2.0:1787098218.264101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098218.264513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059889664 00000100:00100000:1.0:1787098218.264523:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059889664 00000100:00100000:1.0:1787098218.264634:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:1.0:1787098218.264658:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:10262:x1873908059889664:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787098218.264677:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098218.264703:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01448fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287479 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.264765:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144902 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.264780:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.264793:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098218.265000:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787098218.265004:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787098218.265095:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.265120:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01448fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287479 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.265136:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287479 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.265145:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00010000:00010000:1.0:1787098218.265148:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787098218.265151:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413000, rc 0) 00000100:00100000:1.0:1787098218.265227:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:10262:x1873908059889664:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 570us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098218.265242:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00080000:2.0:1787098218.267714:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098218.273270:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098218.273483:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059889792 00000100:00100000:2.0:1787098218.273510:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059889792 00000100:00100000:2.0:1787098218.273706:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:2.0:1787098218.273717:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:10263:x1873908059889792:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098218.273738:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098218.273762:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287480 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.273832:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.273973:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.273986:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.274003:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.274011:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.274018:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.274824:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623200/0xb1d871f9b014491e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.274919:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623200/0xb1d871f9b014491e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.274928:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623200/0xb1d871f9b014491e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098218.275113:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787098218.275117:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098218.275667:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623200/0xb1d871f9b014491e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275683:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275689:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275695:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275701:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098218.275705:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275713:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275728:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00010000:00010000:2.0:1787098218.275731:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098218.275736:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275742:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144910 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275755:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275772:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275777:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275782:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098218.275785:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275791:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275799:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d7203eadd00) 00010000:00010000:2.0:1787098218.275802:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098218.275805:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.275811:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144917 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.280692:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287480 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.280729:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623200/0xb1d871f9b014491e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287480 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098218.280739:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d7203eadb00) 00010000:00010000:2.0:1787098218.280742:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098218.280764:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623200, rc 0) 00000100:00100000:2.0:1787098218.281724:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:10263:x1873908059889792:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 8002us (8459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098218.281734:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:0.0:1787098218.289839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098218.290041:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059890048 00000100:00100000:1.0:1787098218.290053:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059890048 00000100:00100000:1.0:1787098218.290138:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1787098218.290150:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:10263:x1873908059890048:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787098218.290170:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098218.290201:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b0144925 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287487 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.290276:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.290366:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.290377:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.290457:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.290466:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098218.290473:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.296841:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b014493a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.296875:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b014493a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.296887:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b014493a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098218.296913:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787098218.297138:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297147:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297154:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297162:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098218.297166:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297174:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297187:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d7203eadb00) 00010000:00010000:0.0:1787098218.297191:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098218.297196:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297202:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b014492c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297217:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297224:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297241:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297246:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098218.297249:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297256:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297264:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d7208d7f500) 00010000:00010000:0.0:1787098218.297266:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098218.297270:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.297275:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144933 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.298247:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b0144925 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287487 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.298268:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b014493a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287487 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098218.298276:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:0.0:1787098218.298307:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098218.298311:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695a00, rc 0) 00000100:00100000:0.0:1787098218.298606:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+9:10263:x1873908059890048:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 8457us (8776us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787098218.298626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1787098218.304673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098218.304762:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059890176 00000100:00100000:0.0:1787098218.304772:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059890176 00000100:00100000:0.0:1787098218.304854:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1787098218.304865:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+9:10263:x1873908059890176:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787098218.304985:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+9:10263:x1873908059890176:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 122us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098218.304992:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1787098218.640132:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787098218.650159:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077750784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098218.650429:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098218.651594:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077750784 00000100:00100000:0.0:1787098218.651607:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077750784 00000100:00100000:0.0:1787098218.651659:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787098218.651669:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077750784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098218.651704:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098218.651765:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077750784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098218.651772:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787098218.652429:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d72417d9880 x1873908077750784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098218.652463:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077750784:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787098218.686346:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1787098218.897237:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787098218.897382:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787098219.921161:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098219.997764:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098219.997862:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059890304 00000100:00100000:3.0:1787098219.997875:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059890304 00000100:00100000:3.0:1787098219.997945:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:3.0:1787098219.997957:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+8:10306:x1873908059890304:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098219.997985:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098219.998013:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144948 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528748e expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.998160:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.998176:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.998200:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.998219:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.998226:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.998234:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999148:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999165:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999173:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999180:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098219.999186:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999195:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999212:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00010000:00010000:3.0:1787098219.999216:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098219.999221:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999233:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014494f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999251:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999257:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999264:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999270:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098219.999273:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999332:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999341:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d7207e92300) 00010000:00010000:3.0:1787098219.999344:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098219.999346:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999352:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144956 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999402:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144948 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528748e expref: 9 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999437:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00010000:00010000:3.0:1787098219.999440:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098219.999444:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144948 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528748e expref: 9 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098219.999455:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6400, rc 0) 00000100:00100000:3.0:1787098219.999555:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+8:10306:x1873908059890304:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1600us (1806us total) trans 0 rc 301/301 00000100:00100000:3.0:1787098219.999566:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1787098220.008822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.009244:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059890560 00000100:00100000:2.0:1787098220.009260:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059890560 00000100:00100000:2.0:1787098220.009895:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:2.0:1787098220.009911:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+8:10306:x1873908059890560:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:2.0:1787098220.009992:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098220.010032:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144902 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287479 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.010052:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7f300) 00000100:00080000:0.0:1787098220.010187:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787098220.010225:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098220.010905:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.010925:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.010938:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.010958:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.010966:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.010972:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098220.014029:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787098220.014053:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.014065:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.014074:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.014081:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098220.014087:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.014095:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.014341:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098220.014345:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098220.014352:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.014372:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014495d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787098220.014399:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008815b5c7 reply state 00000000f6ba1b2d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098220.014420:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787098220.014617:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+9:10306:x1873908059890560:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 4705us (5804us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787098220.014628:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00010000:00010000:2.0:1787098220.017509:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.017541:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.017550:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.017558:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098220.017563:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.017572:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.017592:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d7203eadf00) 00010000:00010000:2.0:1787098220.017595:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098220.017601:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.017620:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144964 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098220.151867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.151938:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059890688 00000100:00100000:2.0:1787098220.151952:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059890688 00000100:00100000:2.0:1787098220.152040:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:2.0:1787098220.152063:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:10314:x1873908059890688:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:2.0:1787098220.152100:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098220.152141:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014496b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287495 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.152241:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b0144972 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.152261:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b0144972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.152276:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b0144972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098220.152382:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787098220.152388:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098220.152456:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b0144972 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.154762:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014496b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287495 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.154831:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b0144972 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287495 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.154845:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:2.0:1787098220.154849:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098220.154854:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623c00, rc 0) 00000100:00100000:2.0:1787098220.155375:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+9:10314:x1873908059890688:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 3320us (3519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098220.155387:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:2.0:1787098220.240601:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098220.240733:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059890816 00000100:00100000:1.0:1787098220.240883:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059890816 00000100:00100000:1.0:1787098220.241005:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:1.0:1787098220.241018:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+9:10320:x1873908059890816:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1787098220.241047:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098220.241077:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528749c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241177:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241198:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241228:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241249:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241257:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241264:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241468:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b014498e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241476:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b014498e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241482:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b014498e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098220.241534:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787098220.241538:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787098220.241592:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b014498e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241607:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241615:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241623:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241630:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098220.241635:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241642:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241657:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:1.0:1787098220.241661:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098220.241667:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241673:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241689:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241706:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241712:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241717:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098220.241720:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241727:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241735:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d7208d7f100) 00010000:00010000:1.0:1787098220.241738:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098220.241741:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241747:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144987 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241800:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528749c expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241817:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b014498e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528749c expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.241825:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:1.0:1787098220.241827:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787098220.242238:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412800, rc 0) 00000100:00100000:0.0:1787098220.246618:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+10:10320:x1873908059890816:12345-192.168.204.51@tcp:101:bash.0 Request processed in 5583us (6012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098220.246635:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1787098220.255632:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098220.255908:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059891072 00000100:00100000:3.0:1787098220.255923:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059891072 00000100:00100000:3.0:1787098220.256009:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:3.0:1787098220.256023:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+10:10320:x1873908059891072:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1787098220.256054:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098220.256085:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144995 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874a3 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.256676:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.256697:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.256710:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.256729:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.256770:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.256779:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787098220.258593:0:6853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787098220.260486:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.260515:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.260532:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.260604:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.260612:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.260620:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.260628:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098220.260633:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.260642:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.260680:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:3.0:1787098220.260684:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098220.260690:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.260696:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014499c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098220.260721:0:6853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000356b6f97 reply state 0000000063c4ac7e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098220.260733:0:6853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787098220.261979:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144995 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874a3 expref: 13 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.262012:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874a3 expref: 12 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.262022:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:3.0:1787098220.262026:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098220.262030:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6000, rc 0) 00000100:00100000:3.0:1787098220.262146:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+13:10320:x1873908059891072:12345-192.168.204.51@tcp:101:bash.0 Request processed in 6124us (6527us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787098220.262157:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00010000:00010000:1.0:1787098220.269821:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.269913:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.269924:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.269931:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098220.269939:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.269949:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.269971:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7207e92300) 00010000:00010000:1.0:1787098220.269975:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098220.269982:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.269990:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b01449a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098220.272016:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098220.273014:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059891200 00000100:00100000:3.0:1787098220.273032:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059891200 00000100:00100000:3.0:1787098220.273104:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1787098220.273114:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2372:x1873908059891200:12345-192.168.204.51@tcp:8:bash.0 00010000:00080000:3.0:1787098220.273189:0:6703:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:3.0:1787098220.273234:0:6703:0:(genops.c:1406:class_connect()) connect: client 530d6019-f48b-45e0-97e8-95fbd128e52b, cookie 0xb1d871f9b01449b8 00002000:00100000:3.0:1787098220.273251:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 530d6019-f48b-45e0-97e8-95fbd128e52b/ffff8d7227475000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787098220.273337:0:6703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787098220.273666:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787098220.275953:0:6703:0:(import.c:65:import_set_state_nolock()) ffff8d7227470000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787098220.276090:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2372:x1873908059891200:12345-192.168.204.51@tcp:8:bash.0 Request processed in 2970us (4085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098220.276115:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1787098220.284976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098220.285781:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059891328 00000100:00100000:3.0:1787098220.285798:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059891328 00000100:00080000:0.0:1787098220.286026:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787098220.286094:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1787098220.286118:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:0:x1873908059891328:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1787098220.286154:0:6860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098220.286187:0:6860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874aa expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787098220.286226:0:6860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787098220.286252:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=318s v=(0 0) 00010000:00010000:3.0:1787098220.286260:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098220.286271:0:6860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874aa expref: 7 pid: 6860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.286341:0:6860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874aa expref: 7 pid: 6860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.286357:0:6860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6400, rc 0) 00000100:00100000:3.0:1787098220.286448:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:0:x1873908059891328:12345-192.168.204.51@tcp:101:bash.0 Request processed in 333us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098220.286475:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1787098220.296073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.296545:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059891456 00000100:00100000:2.0:1787098220.296568:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059891456 00000100:00100000:2.0:1787098220.296649:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1787098220.296661:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:10320:x1873908059891456:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1787098220.296693:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098220.296722:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874b1 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.296789:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874aa expref: 8 pid: 6860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.296800:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098220.296806:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098220.296811:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.296857:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874aa expref: 8 pid: 6860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.296879:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874aa expref: 8 pid: 6860 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098220.296897:0:6701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1873908077750912:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098220.297840:0:6701:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723b989900 going to sleep for 11 seconds 00000100:00100000:3.0:1787098220.306842:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098220.307028:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059891584 00000100:00100000:1.0:1787098220.307042:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059891584 00010000:00010000:1.0:1787098220.307102:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874aa expref: 9 pid: 6860 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098220.307159:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1787098220.307171:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2373:x1873908059891584:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098220.307222:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098220.307261:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874aa expref: 9 pid: 6860 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.307353:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874aa expref: 9 pid: 6860 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.307395:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098220.307401:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098220.307488:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.307504:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.307557:0:11681:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098220.307577:0:11681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11681:1873908077751040:192.168.204.51@tcp:105: 00000100:00100000:1.0:1787098220.307919:0:11681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72087ca0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787098220.310804:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c410b71e/0xb1d871f9b01449bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874aa expref: 9 pid: 6860 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098220.311315:0:6701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6701:1873908077750912:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098220.311370:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.311393:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623800, rc 0) 00000100:00100000:2.0:1787098220.311532:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+8:10320:x1873908059891456:12345-192.168.204.51@tcp:101:bash.0 Request processed in 14870us (15471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098220.311543:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1787098220.312176:0:11681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11681:1873908077751040:192.168.204.51@tcp:105: 00010000:00010000:1.0:1787098220.312197:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098220.312230:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059891584:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 5061us (5404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098220.312242:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1787098220.317476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.318014:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059891840 00000100:00100000:2.0:1787098220.318028:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059891840 00000100:00100000:2.0:1787098220.318106:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1787098220.318118:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+12:10320:x1873908059891840:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1787098220.318685:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+13:10320:x1873908059891840:12345-192.168.204.51@tcp:35:bash.0 Request processed in 566us (1221us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787098220.318694:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1787098220.413922:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.414328:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059892096 00000100:00100000:2.0:1787098220.414343:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059892096 00000100:00100000:2.0:1787098220.414435:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:2.0:1787098220.414449:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:10330:x1873908059892096:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098220.414611:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098220.414642:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01449cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874b8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098220.414841:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787098220.415851:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01449cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b8 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.418250:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:2.0:1787098220.418256:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098220.418446:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01449cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b8 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.418762:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622c00, rc 0) 00000100:00100000:2.0:1787098220.419486:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+14:10330:x1873908059892096:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 5032us (5571us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787098220.419499:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:1.0:1787098220.430265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098220.430430:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059892352 00000100:00100000:0.0:1787098220.430443:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059892352 00000100:00100000:0.0:1787098220.431040:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098220.431071:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+14:10330:x1873908059892352:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1787098220.431553:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+15:10330:x1873908059892352:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 499us (1303us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787098220.431563:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098220.520455:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.523438:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059892480 00000100:00100000:2.0:1787098220.523459:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059892480 00000100:00100000:2.0:1787098220.523564:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1787098220.523578:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+15:10336:x1873908059892480:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098220.523614:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098220.523645:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01449db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874bf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.523738:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01449e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.523756:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01449e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.523770:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01449e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098220.523852:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787098220.523856:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098220.523885:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01449e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.523918:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b01449db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874bf expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.523963:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01449e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874bf expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.523974:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098220.523977:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098220.523981:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623000, rc 0) 00000100:00100000:2.0:1787098220.524077:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+16:10336:x1873908059892480:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 501us (3638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098220.524086:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:3.0:1787098220.531174:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098220.531478:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059892736 00000100:00100000:0.0:1787098220.531504:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059892736 00000100:00100000:0.0:1787098220.531600:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1787098220.531614:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+16:10336:x1873908059892736:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098220.531643:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098220.531687:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01449e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874c6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.531860:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01449f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.531880:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01449f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.531894:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01449f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098220.531908:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787098220.532265:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01449e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874c6 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.532365:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01449f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874c6 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.532377:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:0.0:1787098220.532381:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098220.532385:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695200, rc 0) 00000100:00100000:0.0:1787098220.532490:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:10336:x1873908059892736:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 878us (1332us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787098220.532500:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:1.0:1787098220.541998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098220.542413:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059892864 00000100:00100000:0.0:1787098220.542427:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059892864 00000100:00100000:0.0:1787098220.542752:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:0.0:1787098220.542768:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+18:2376:x1873908059892864:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098220.542793:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098220.542832:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01449f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874c6 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.542859:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:0.0:1787098220.542865:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098220.542956:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+17:2376:x1873908059892864:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 192us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098220.542965:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1787098220.548520:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098220.548647:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059893120 00000100:00100000:0.0:1787098220.548663:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059893120 00000100:00100000:0.0:1787098220.549244:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1787098220.549312:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+17:10336:x1873908059893120:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098220.549421:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098220.549455:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01449fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874cd expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.549602:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.549621:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.549635:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098220.549651:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787098220.549826:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01449fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874cd expref: 20 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.549851:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874cd expref: 19 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.549862:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:0.0:1787098220.549865:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787098220.549869:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695600, rc 0) 00000100:00100000:0.0:1787098220.550019:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+19:10336:x1873908059893120:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 742us (1514us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787098220.550028:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1787098220.557013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098220.557174:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059893248 00000100:00100000:1.0:1787098220.557187:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059893248 00000100:00100000:1.0:1787098220.557478:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1787098220.557493:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059893248:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:1.0:1787098220.557567:0:6860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.557597:0:6860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.557609:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098220.557615:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787098220.557620:0:6860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.557671:0:6860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.557700:0:6860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 7 pid: 6701 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098220.557722:0:6860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6860:1873908077751168:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098220.557910:0:6860:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72087ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098220.561794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.563476:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059893376 00000100:00100000:2.0:1787098220.563497:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059893376 00002000:00100000:2.0:1787098220.563575:0:6707:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d723b73d180 x1873908059893376/t0(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:396/0 lens 504/0 e 0 to 0 dl 1787098231 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787098220.563589:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b73d180 with x1873908059893376 ext(0->12) 00010000:00010000:2.0:1787098220.563601:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 8 pid: 6701 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.563623:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 8 pid: 6701 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098220.563632:0:6707:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d723b73d180 00000100:00100000:2.0:1787098220.563677:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1787098220.563689:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2374:x1873908059893376:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:3.0:1787098220.564716:0:6860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6860:1873908077751168:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098220.564754:0:6860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098220.578449:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098220.578487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098220.578922:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059893504 00000100:00100000:3.0:1787098220.578936:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059893504 00000100:00100000:3.0:1787098220.578995:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 277 00000100:00100000:3.0:1787098220.579006:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059893504:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098220.579081:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059893504:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 77us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098220.579089:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 277 00000100:00100000:0.0:1787098220.585244:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059893632 00000100:00100000:0.0:1787098220.585259:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059893632 00000100:00100000:0.0:1787098220.585372:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:0.0:1787098220.585382:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059893632:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098220.585483:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059893632:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 102us (6994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098220.585491:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00080000:0.0:1787098220.585522:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1787098220.641318:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000100:00100000:3.0:1787098220.690857:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098220.690885:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ad41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077751296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098220.690970:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098220.691049:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077751296 00000100:00100000:3.0:1787098220.691057:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077751296 00000100:00100000:3.0:1787098220.691135:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787098220.691146:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077751296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787098220.691191:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098220.691250:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077751296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098220.691271:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787098220.691320:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787098220.691364:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ad41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077751296:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787098220.695106:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1787098220.695665:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059893376:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 131968us (133874us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787098220.695689:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00002000:00100000:3.0:1787098220.695708:0:6707:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8d723b73d180 x1873908059893376/t4294967299(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:396/0 lens 504/448 e 0 to 0 dl 1787098231 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787098220.695720:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b73d180 with x1873908059893376 ext(0->12) 00010000:00010000:3.0:1787098220.695734:0:6707:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 7 pid: 6701 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098220.695756:0:6707:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 7 pid: 6701 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787098220.695766:0:6707:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d723b73d180 00000100:00100000:1.0:1787098220.699734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.703427:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059893760 00000100:00100000:2.0:1787098220.703472:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059893760 00010000:00010000:0.0:1787098220.703597:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 7 pid: 6701 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098220.703658:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1787098220.703671:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2375:x1873908059893760:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098220.703692:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787098220.703722:0:11178:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787098220.703726:0:11178:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787098220 00002000:00010000:0.0:1787098220.703729:0:11178:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787098220 00002000:00010000:0.0:1787098220.703731:0:11178:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787098220 00002000:00010000:0.0:1787098220.703733:0:11178:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1787098220.703741:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 7 pid: 6701 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.703759:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 7 pid: 6701 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.703792:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01449c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874b1 expref: 7 pid: 6701 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.703824:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098220.703830:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098220.703838:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.703850:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.703897:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098220.703992:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2375:x1873908059893760:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 323us (4272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098220.704001:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00010000:00010000:1.0:1787098220.704404:0:6860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.704416:0:6860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.704451:0:6860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.704460:0:6860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.704470:0:6860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.704479:0:6860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098220.704484:0:6860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.704493:0:6860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.704514:0:6860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.704536:0:6860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008438f072/0xb1d871f9b0144a13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098220.706052:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059893248:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 148551us (149042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098220.706067:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1787098220.712882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098220.712969:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059894016 00000100:00100000:0.0:1787098220.712983:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059894016 00000100:00100000:0.0:1787098220.713062:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1787098220.713074:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+19:10336:x1873908059894016:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:0.0:1787098220.713167:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874cd expref: 19 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787098220.713702:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787098220.713766:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787098220.715171:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787098220.715458:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.715484:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874a3 expref: 23 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.715569:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.715627:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874a3 expref: 23 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.715647:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874a3 expref: 23 pid: 6853 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098220.715666:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206deed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1873908077751424:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098220.715873:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098220.724195:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206deed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1873908077751424:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098220.724536:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098220.729122:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098220.729461:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059894144 00000100:00100000:0.0:1787098220.729477:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059894144 00010000:00010000:0.0:1787098220.729540:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874a3 expref: 24 pid: 6853 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098220.729601:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1787098220.729613:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+24:2373:x1873908059894144:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098220.729632:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098220.729641:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874a3 expref: 24 pid: 6853 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.729679:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874a3 expref: 24 pid: 6853 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.729708:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01449aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874a3 expref: 24 pid: 6853 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.729732:0:11681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:0.0:1787098220.729738:0:11681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.729750:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.729764:0:11681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.729803:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098220.729887:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+23:2373:x1873908059894144:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 275us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098220.729894:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00010000:00010000:1.0:1787098220.730458:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.730470:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787098220.731810:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787098220.732126:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787098220.732385:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077751552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787098220.732567:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098220.732617:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098220.733425:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077751552 00000100:00100000:3.0:1787098220.733438:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077751552 00000100:00100000:3.0:1787098220.733569:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098220.733583:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1873908077751552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787098220.733712:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1873908077751552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 132us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098220.733721:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787098220.735329:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077751552:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787098220.735618:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787098220.736215:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787098220.736362:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077751680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787098220.736457:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098220.741932:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241ac2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787098220.742467:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077751680 00000100:00100000:2.0:1787098220.742481:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077751680 00000100:00100000:2.0:1787098220.742563:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098220.742574:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1873908077751680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787098220.743006:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1873908077751680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 433us (6547us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787098220.743016:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787098220.744571:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077751680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787098220.744724:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787098220.744814:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.744826:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.744836:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.744844:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098220.744850:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.744860:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.744880:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:1.0:1787098220.744884:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787098220.744889:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098220.744896:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144a1a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787098220.746742:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787098220.749368:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787098220.749416:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319005134847ns, next at 320005127547ns, rc = 0 00000001:00080000:1.0:1787098220.749440:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787098220.749544:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:1.0:1787098220.749549:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787098220.749583:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874cd expref: 27 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098220.749782:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+26:10336:x1873908059894016:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 36709us (36914us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787098220.749801:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000020:00080000:1.0:1787098220.749810:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787098220.758889:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.761034:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059894272 00000100:00100000:2.0:1787098220.761052:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059894272 00000100:00100000:2.0:1787098220.761142:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1787098220.761154:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+26:10336:x1873908059894272:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098220.761185:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098220.761216:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144a21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874d4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.761317:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874d4 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.761352:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874d4 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.761378:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098220.761382:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098220.761386:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623400, rc 0) 00000100:00100000:2.0:1787098220.761610:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+27:10336:x1873908059894272:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 458us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098220.761618:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:3.0:1787098220.768635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.768757:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059894528 00000100:00100000:2.0:1787098220.768773:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059894528 00000100:00100000:2.0:1787098220.768851:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1787098220.768862:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+27:10336:x1873908059894528:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1787098220.769804:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+28:10336:x1873908059894528:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 936us (1175us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787098220.769817:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1787098220.871438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.871667:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059894784 00000100:00100000:2.0:1787098220.871680:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059894784 00000100:00100000:2.0:1787098220.871766:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1787098220.871780:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+28:10346:x1873908059894784:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098220.871815:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098220.871849:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144a28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874db expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098220.872004:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787098220.872171:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144a28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874db expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.872189:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:2.0:1787098220.872193:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098220.872198:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144a28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874db expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.872215:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622200, rc 0) 00000100:00100000:2.0:1787098220.872371:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+29:10346:x1873908059894784:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 594us (948us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787098220.872417:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:1.0:1787098220.875658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098220.875842:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059894912 00000100:00100000:0.0:1787098220.875857:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059894912 00000100:00100000:0.0:1787098220.876232:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:0.0:1787098220.876245:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+29:10346:x1873908059894912:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1787098220.876740:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.876889:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.876904:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.876923:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.876929:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.876936:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877087:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877095:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877102:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787098220.877155:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877171:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877178:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877195:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877519:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098220.877527:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877537:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877553:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:0.0:1787098220.877556:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098220.877562:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877568:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877586:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877593:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877599:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877604:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098220.877607:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877623:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877631:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7208701400) 00010000:00010000:0.0:1787098220.877633:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098220.877636:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877643:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877658:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877664:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877670:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877676:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098220.877679:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877684:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877690:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098220.877692:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098220.877695:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.877709:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098220.882244:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+29:10346:x1873908059894912:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 5974us (6572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098220.882272:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1787098220.895782:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.896411:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059895168 00000100:00100000:2.0:1787098220.896426:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059895168 00000100:00100000:2.0:1787098220.896573:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1787098220.896586:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+29:10346:x1873908059895168:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1787098220.896976:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+30:10346:x1873908059895168:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 392us (1209us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787098220.896986:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00010000:00010000:3.0:1787098220.950428:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098220.958829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098220.958958:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059895424 00000100:00100000:0.0:1787098220.958973:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059895424 00000100:00100000:0.0:1787098220.959062:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1787098220.959075:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+30:10349:x1873908059895424:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098220.959115:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098220.959144:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874e2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.959265:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.959328:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.959345:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.959363:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.959370:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.959413:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960142:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960155:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960164:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098220.960177:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787098220.960446:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960455:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960462:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960469:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098220.960474:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960482:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960711:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:0.0:1787098220.960716:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098220.960728:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960736:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144a52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960754:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960760:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960766:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960772:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098220.960776:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960782:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960791:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7208701400) 00010000:00010000:0.0:1787098220.960794:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098220.960796:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960802:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960869:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e2 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960899:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e2 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098220.960908:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098220.960911:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098220.960914:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695600, rc 0) 00000100:00100000:0.0:1787098220.961007:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+32:10349:x1873908059895424:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1933us (2193us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787098220.961016:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:1.0:1787098220.968668:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098220.968791:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059895552 00000100:00100000:2.0:1787098220.968804:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059895552 00000100:00100000:2.0:1787098220.968888:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1787098220.968902:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+32:10349:x1873908059895552:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1787098220.969009:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.969031:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.969121:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.969158:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.969165:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.969192:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.969268:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098220.969275:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.969339:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.969356:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098220.969359:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098220.969365:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098220.969373:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098220.969544:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+32:10349:x1873908059895552:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 644us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098220.969554:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:1.0:1787098220.983971:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098220.984087:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059895808 00000100:00100000:3.0:1787098220.984100:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059895808 00000100:00100000:3.0:1787098220.984175:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1787098220.984188:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+32:10349:x1873908059895808:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1787098220.984763:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+33:10349:x1873908059895808:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 575us (804us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787098220.984773:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1787098221.188416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098221.188778:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059896064 00000100:00100000:2.0:1787098221.188792:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059896064 00000100:00100000:2.0:1787098221.188876:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:2.0:1787098221.188900:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+33:10380:x1873908059896064:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1787098221.188934:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098221.188965:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874e9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.189510:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.189530:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.189544:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098221.189557:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787098221.191415:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e9 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.191453:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e9 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.191464:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098221.191468:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098221.191472:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622a00, rc 0) 00000100:00100000:2.0:1787098221.191651:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+35:10380:x1873908059896064:12345-192.168.204.51@tcp:101:cat.0 Request processed in 2764us (3248us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787098221.191728:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:1.0:1787098221.197273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098221.197465:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059896320 00000100:00100000:2.0:1787098221.197479:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059896320 00000100:00100000:2.0:1787098221.197559:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1787098221.197572:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+35:10380:x1873908059896320:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:2.0:1787098221.198235:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+36:10380:x1873908059896320:12345-192.168.204.51@tcp:35:cat.0 Request processed in 662us (974us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787098221.198264:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1787098221.199820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098221.200682:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059896448 00000100:00100000:0.0:1787098221.200698:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059896448 00000100:00100000:0.0:1787098221.200797:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1787098221.200810:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d721fa99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+36:2375:x1873908059896448:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098221.200843:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098221.201336:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e9 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.201359:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098221.201366:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098221.202174:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d721fa99850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+35:2375:x1873908059896448:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1362us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098221.202187:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1787098221.269446:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098221.274077:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059896704 00000100:00100000:2.0:1787098221.274101:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059896704 00000100:00100000:2.0:1787098221.274220:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1787098221.274233:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+35:10386:x1873908059896704:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:2.0:1787098221.274270:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098221.274275:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787098221.274351:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01449e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874bf expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.274380:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098221.274398:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098221.274417:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874f0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.274557:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.274574:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e2 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.274584:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.274627:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e2 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.274643:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e2 expref: 35 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098221.275083:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077751808:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098221.275248:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722b7a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787098221.278439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098221.278460:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077751808:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098221.278513:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098221.278638:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059896832 00000100:00100000:0.0:1787098221.278651:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059896832 00010000:00010000:0.0:1787098221.278697:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e2 expref: 36 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098221.278758:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:0.0:1787098221.278768:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+36:2373:x1873908059896832:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098221.278786:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098221.278793:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e2 expref: 36 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.278805:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e2 expref: 36 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.278835:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874e2 expref: 36 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.278853:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098221.278859:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.278869:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.278877:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.278907:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098221.278938:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.278950:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098221.278973:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+35:2373:x1873908059896832:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 204us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098221.278984:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000004:00200000:2.0:1787098221.278994:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787098221.280225:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144a8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f0 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.280257:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f0 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.280267:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098221.280270:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787098221.280275:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622a00, rc 0) 00000100:00100000:2.0:1787098221.280373:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+35:10386:x1873908059896704:12345-192.168.204.51@tcp:101:dd.0 Request processed in 6141us (10942us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787098221.280394:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:3.0:1787098221.284183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098221.290255:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059897088 00000100:00100000:0.0:1787098221.290299:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059897088 00000100:00100000:0.0:1787098221.290381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1787098221.290403:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+35:10386:x1873908059897088:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:0.0:1787098221.290918:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.290934:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.290945:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787098221.290996:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787098221.291023:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000539907a5 reply state 00000000221d879c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098221.291033:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787098221.291942:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+38:10386:x1873908059897088:12345-192.168.204.51@tcp:36:dd.0 Request processed in 1534us (7764us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787098221.291954:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000020:00080000:0.0:1787098221.291960:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787098221.302889:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.302926:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.302935:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.302943:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098221.302948:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.302956:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.302977:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098221.302980:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098221.302986:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.302992:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144a9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098221.616190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098221.616651:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059897216 00000100:00100000:0.0:1787098221.616662:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059897216 00000100:00100000:0.0:1787098221.616730:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1787098221.616740:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+37:10400:x1873908059897216:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:0.0:1787098221.616771:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098221.616794:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874f7 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.616866:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.616895:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.616906:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.616923:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.616930:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.616935:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.617029:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.617039:0:6853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f0 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.617048:0:6853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.617078:0:6853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f0 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.617091:0:6853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f0 expref: 38 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098221.617132:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206dece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077751936:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098221.617247:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abf840 going to sleep for 11 seconds 00000100:00100000:1.0:1787098221.619900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098221.619976:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059897472 00000100:00100000:3.0:1787098221.619986:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059897472 00000100:00100000:3.0:1787098221.620047:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1787098221.620056:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+39:5609:x1873908059897472:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787098221.620455:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+40:5609:x1873908059897472:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 398us (565us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787098221.620462:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1787098221.621269:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206dece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077751936:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098221.621310:0:6853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098221.629972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098221.630060:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059897600 00000100:00100000:3.0:1787098221.630071:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059897600 00010000:00010000:3.0:1787098221.630117:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f0 expref: 40 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098221.630226:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1787098221.630239:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+40:2374:x1873908059897600:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098221.630271:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098221.630559:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f0 expref: 40 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098221.630576:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f0 expref: 40 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098221.630598:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144a91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f0 expref: 40 pid: 5844 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098221.630615:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:3.0:1787098221.630620:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098221.630629:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098221.630636:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098221.630669:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098221.630724:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+39:2374:x1873908059897600:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 489us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098221.630731:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00010000:00010000:0.0:1787098221.630798:0:6853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630807:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098221.630856:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787098221.630861:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098221.630905:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630918:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630927:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630934:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630940:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630946:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098221.630956:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630963:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630972:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:0.0:1787098221.630974:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098221.630978:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630983:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144aad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.630994:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.631000:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.631005:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.631010:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098221.631012:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.631017:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.631022:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7208701400) 00010000:00010000:0.0:1787098221.631024:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098221.631033:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.631039:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.631076:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f7 expref: 39 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.631091:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f7 expref: 38 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.631098:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098221.631100:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098221.631103:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695000, rc 0) 00000100:00100000:0.0:1787098221.631129:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+38:10400:x1873908059897216:12345-192.168.204.51@tcp:101:stat.0 Request processed in 14391us (14950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098221.631138:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:1.0:1787098221.713117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098221.713275:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059897856 00000100:00100000:2.0:1787098221.713318:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059897856 00000100:00100000:2.0:1787098221.713397:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:2.0:1787098221.713412:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+38:10406:x1873908059897856:12345-192.168.204.51@tcp:36:truncate.0 00010000:00010000:2.0:1787098221.713500:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098221.713532:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144abb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874f7 expref: 38 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.713564:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098221.713582:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098221.713830:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.713844:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.713854:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098221.713906:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787098221.713933:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fadcc92c reply state 00000000c648a410 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098221.713943:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787098221.714064:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+40:10406:x1873908059897856:12345-192.168.204.51@tcp:36:truncate.0 Request processed in 655us (954us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787098221.714071:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000020:00080000:2.0:1787098221.714077:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787098221.720640:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.720659:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.720667:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.720683:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098221.720703:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.720712:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.720729:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098221.720733:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098221.720738:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.720744:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098221.868053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098221.868310:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059897984 00000100:00100000:2.0:1787098221.868320:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059897984 00000100:00100000:2.0:1787098221.868392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:2.0:1787098221.868402:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+39:10420:x1873908059897984:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:2.0:1787098221.868428:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098221.868453:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52874fe expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868538:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868552:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868565:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868580:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868600:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868607:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868710:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868719:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868726:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098221.868763:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787098221.868769:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098221.868790:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868801:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868810:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868817:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868824:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868840:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098221.868845:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868853:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868865:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098221.868868:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098221.868873:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868879:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144ad0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868892:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868899:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868905:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868911:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098221.868914:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868920:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868937:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7203ead800) 00010000:00010000:2.0:1787098221.868939:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098221.868942:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868947:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144ad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.868990:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144ac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874fe expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.869004:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874fe expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098221.869011:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098221.869014:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098221.869016:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622800, rc 0) 00000100:00100000:2.0:1787098221.869091:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+40:10420:x1873908059897984:12345-192.168.204.51@tcp:101:stat.0 Request processed in 690us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098221.869109:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:1.0:1787098221.930991:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098221.931606:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059898240 00000100:00100000:0.0:1787098221.931617:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059898240 00000100:00100000:0.0:1787098221.931831:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1787098221.931843:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+40:10430:x1873908059898240:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098221.931866:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098221.931888:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144ae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287505 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098221.932175:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787098221.932400:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144ae5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287505 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.932438:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:0.0:1787098221.932441:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787098221.932447:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144ae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287505 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.932463:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695600, rc 0) 00000100:00100000:0.0:1787098221.932655:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+41:10430:x1873908059898240:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 813us (1672us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787098221.932663:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:1.0:1787098221.936172:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098221.936556:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059898496 00000100:00100000:3.0:1787098221.936567:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059898496 00000100:00100000:3.0:1787098221.936682:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1787098221.936693:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+41:10430:x1873908059898496:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1787098221.936990:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+42:10430:x1873908059898496:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 298us (826us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787098221.936999:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00010000:00010000:2.0:1787098221.968091:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098221.985821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098221.985945:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059898752 00000100:00100000:0.0:1787098221.985955:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059898752 00000100:00100000:0.0:1787098221.986022:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1787098221.986032:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+42:10436:x1873908059898752:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098221.986058:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098221.986081:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144af3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528750c expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.986179:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.986194:0:6853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874fe expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.986204:0:6853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.986238:0:6853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874fe expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.986266:0:6853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874fe expref: 43 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098221.986307:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7206dece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077752064:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098221.986410:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098221.988470:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7206dece00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077752064:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098221.988499:0:6853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098221.993981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098221.996430:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059898880 00000100:00100000:0.0:1787098221.996443:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059898880 00010000:00010000:0.0:1787098221.996501:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874fe expref: 44 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098221.996543:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1787098221.996552:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+44:2374:x1873908059898880:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098221.996566:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098221.996573:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874fe expref: 44 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.996586:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874fe expref: 44 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.996608:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874fe expref: 44 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.996643:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098221.996648:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.996657:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.996664:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098221.996697:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098221.996759:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+43:2374:x1873908059898880:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 207us (2788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098221.996766:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00010000:00010000:3.0:1787098221.996874:0:6853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098221.996883:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098221.996901:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787098221.997051:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144af3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528750c expref: 44 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098221.997065:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528750c expref: 43 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098221.997073:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:3.0:1787098221.997076:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787098221.997078:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:3.0:1787098221.997100:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+43:10436:x1873908059898752:12345-192.168.204.51@tcp:101:bash.0 Request processed in 11071us (11289us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787098221.997106:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1787098222.000266:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098222.000472:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059899136 00000100:00100000:2.0:1787098222.000491:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059899136 00000100:00100000:2.0:1787098222.000568:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1787098222.000579:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+43:10436:x1873908059899136:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:2.0:1787098222.000830:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.000865:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.000877:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098222.000926:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787098222.000952:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea98f4b3 reply state 0000000008fa161a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098222.000961:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1787098222.001091:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098222.001218:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+46:10436:x1873908059899136:12345-192.168.204.51@tcp:36:bash.0 Request processed in 641us (960us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787098222.001226:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000020:00080000:2.0:1787098222.001232:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787098222.006599:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.006618:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.006626:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.006632:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098222.006637:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.006644:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.006679:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098222.006681:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098222.006686:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.006692:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144b08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098222.015983:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098222.016438:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059899264 00000100:00100000:2.0:1787098222.016450:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059899264 00000100:00100000:2.0:1787098222.016580:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:2.0:1787098222.016592:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+45:10436:x1873908059899264:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1787098222.016632:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098222.016656:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287513 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.016740:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.016754:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528750c expref: 46 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.016779:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.016822:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528750c expref: 46 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.016834:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528750c expref: 46 pid: 6853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098222.016847:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077752192:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098222.016930:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722b7a3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787098222.021441:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098222.022522:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059899392 00000100:00100000:0.0:1787098222.022537:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059899392 00010000:00010000:0.0:1787098222.022577:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528750c expref: 47 pid: 6853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098222.022630:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:0.0:1787098222.022641:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+47:2373:x1873908059899392:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098222.022656:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098222.022663:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528750c expref: 47 pid: 6853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.022677:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528750c expref: 47 pid: 6853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.022701:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098222.022706:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.022716:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.022744:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.022763:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098222.022820:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144afa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528750c expref: 47 pid: 6853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098222.022826:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+47:2373:x1873908059899392:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 187us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098222.022833:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:3.0:1787098222.022838:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b724a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077752192:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098222.022861:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.024153:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.024162:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098222.024211:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787098222.024216:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098222.024236:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.024360:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287513 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.024451:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287513 expref: 45 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.024459:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:3.0:1787098222.024462:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098222.024465:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622e00, rc 0) 00000100:00100000:3.0:1787098222.024625:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+45:10436:x1873908059899264:12345-192.168.204.51@tcp:101:bash.0 Request processed in 8034us (8650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098222.024634:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:2.0:1787098222.029976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098222.030085:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059899648 00000100:00100000:1.0:1787098222.030096:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059899648 00000100:00100000:1.0:1787098222.030151:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1787098222.030159:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+45:10436:x1873908059899648:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1787098222.030681:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+46:10436:x1873908059899648:12345-192.168.204.51@tcp:35:bash.0 Request processed in 520us (712us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787098222.030689:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1787098222.133962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098222.134084:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059899904 00000100:00100000:0.0:1787098222.134093:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059899904 00000100:00100000:0.0:1787098222.134159:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1787098222.134168:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+46:10446:x1873908059899904:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098222.134193:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098222.134215:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144b1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528751a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098222.134385:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787098222.134635:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144b1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528751a expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.134649:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:0.0:1787098222.134652:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787098222.134657:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144b1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528751a expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.134672:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695200, rc 0) 00000100:00100000:0.0:1787098222.134774:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+47:10446:x1873908059899904:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 606us (823us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787098222.134799:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1787098222.138097:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098222.138271:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059900032 00000100:00100000:3.0:1787098222.138325:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059900032 00000100:00100000:3.0:1787098222.138542:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1787098222.138623:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+47:10446:x1873908059900032:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:3.0:1787098222.138788:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.138825:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.138839:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.138859:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.138866:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.138871:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139119:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139129:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139136:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098222.139323:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139338:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139345:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139363:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139382:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098222.139387:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139394:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139406:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:3.0:1787098222.139409:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098222.139413:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139418:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139436:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139442:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139447:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139452:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098222.139455:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139472:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139480:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7207e92b00) 00010000:00010000:3.0:1787098222.139483:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098222.139486:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139491:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139508:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139514:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139519:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139524:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098222.139527:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139533:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139540:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:3.0:1787098222.139615:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098222.139621:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.139711:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098222.139882:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+47:10446:x1873908059900032:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1260us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098222.142261:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:2.0:1787098222.145502:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098222.145574:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059900288 00000100:00100000:3.0:1787098222.145586:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059900288 00000100:00100000:3.0:1787098222.145825:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1787098222.145837:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+47:10446:x1873908059900288:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1787098222.146974:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+48:10446:x1873908059900288:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 1134us (1478us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787098222.146985:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1787098222.212108:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098222.212578:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059900544 00000100:00100000:2.0:1787098222.212588:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059900544 00000100:00100000:2.0:1787098222.212651:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:2.0:1787098222.212661:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+48:10449:x1873908059900544:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098222.212685:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098222.212705:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287521 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.212777:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.212792:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.212820:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.212837:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.212844:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.212849:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.212981:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144b55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.212990:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.212997:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098222.213007:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787098222.213105:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213111:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213118:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213124:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098222.213133:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213141:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213153:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098222.213156:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098222.213160:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213165:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213180:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213185:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213190:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213195:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098222.213198:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213203:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213209:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7203ead800) 00010000:00010000:2.0:1787098222.213212:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098222.213220:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213226:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.213268:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287521 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.215034:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287521 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.215050:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098222.215053:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098222.215056:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622600, rc 0) 00000100:00100000:2.0:1787098222.215153:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+50:10449:x1873908059900544:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 2491us (3064us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787098222.215162:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1787098222.228237:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098222.228458:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059900672 00000100:00100000:2.0:1787098222.228487:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059900672 00000100:00100000:2.0:1787098222.228547:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1787098222.228558:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+50:10449:x1873908059900672:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1787098222.228631:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.228649:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.228660:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.228709:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.228716:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.228724:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.228732:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098222.228736:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.228744:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.228757:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:2.0:1787098222.228760:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098222.228766:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.228772:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098222.228853:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+50:10449:x1873908059900672:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 297us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098222.228861:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1787098222.237789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098222.237898:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098222.238002:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059901056 00000100:00100000:2.0:1787098222.238012:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059901056 00000100:00100000:2.0:1787098222.238084:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1787098222.238108:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+50:10449:x1873908059901056:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1787098222.238386:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+51:10449:x1873908059901056:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 279us (487us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787098222.238394:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1787098222.239766:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059900800 00000100:00100000:3.0:1787098222.239779:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059900800 00000100:00100000:3.0:1787098222.239893:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1787098222.239903:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+51:2373:x1873908059900800:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098222.239916:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098222.239942:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144b55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287521 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.239962:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:3.0:1787098222.239967:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098222.240024:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+50:2373:x1873908059900800:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 122us (2245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098222.240056:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1787098222.413249:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098222.414054:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059901312 00000100:00100000:0.0:1787098222.414066:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059901312 00000100:00100000:0.0:1787098222.414213:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:0.0:1787098222.414224:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+50:10467:x1873908059901312:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1787098222.414252:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098222.414275:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144b6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287528 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.414664:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144b71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.414680:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144b71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.414693:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144b71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098222.414705:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787098222.414832:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144b6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287528 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.414852:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144b71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287528 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.414861:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098222.414877:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787098222.414881:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695200, rc 0) 00000100:00100000:0.0:1787098222.414999:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10467:x1873908059901312:12345-192.168.204.51@tcp:101:cat.0 Request processed in 777us (1761us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787098222.415006:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1787098222.439830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098222.439920:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059901440 00000100:00100000:3.0:1787098222.439931:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059901440 00000100:00100000:3.0:1787098222.440011:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1787098222.440021:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10468:x1873908059901440:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098222.440048:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098222.440069:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528752f expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.440149:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.440162:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.440174:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098222.440241:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787098222.440245:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098222.440266:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.440591:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528752f expref: 54 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.440614:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528752f expref: 53 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.440643:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:3.0:1787098222.440646:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098222.440649:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6600, rc 0) 00000100:00100000:3.0:1787098222.440719:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10468:x1873908059901440:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 699us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098222.440726:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1787098222.447151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098222.447352:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059901824 00000100:00100000:0.0:1787098222.447371:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059901824 00000100:00100000:0.0:1787098222.447436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1787098222.447446:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10468:x1873908059901824:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1787098222.447810:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10468:x1873908059901824:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 364us (668us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787098222.447818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1787098222.450688:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098222.450797:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059901952 00000100:00100000:0.0:1787098222.450808:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059901952 00000100:00100000:0.0:1787098222.450918:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1787098222.450929:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10468:x1873908059901952:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:0.0:1787098222.450946:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787098222.450987:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287513 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.451012:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144b71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287528 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.451028:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144a21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52874d4 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098222.451039:0:11681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eadd00) 00010000:00010000:0.0:1787098222.451063:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098222.451172:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+51:10468:x1873908059901952:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 245us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098222.451180:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1787098222.453749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098222.453839:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059902080 00000100:00100000:2.0:1787098222.453849:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059902080 00000100:00100000:2.0:1787098222.453933:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:2.0:1787098222.453944:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+51:10468:x1873908059902080:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:2.0:1787098222.454210:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.454228:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098222.454240:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787098222.454594:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787098222.454778:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787098222.454844:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787098222.455022:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+51:10468:x1873908059902080:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 1077us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098222.455032:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1787098222.470990:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098222.471244:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059902208 00000100:00100000:3.0:1787098222.471256:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059902208 00000100:00100000:3.0:1787098222.471412:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:3.0:1787098222.471423:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+51:10470:x1873908059902208:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098222.471445:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098222.471477:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287536 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471544:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471559:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471570:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471586:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471592:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471617:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471726:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471735:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471742:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098222.471776:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787098222.471780:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098222.471797:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471808:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471816:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471822:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471828:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471834:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098222.471838:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471852:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471864:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:3.0:1787098222.471867:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098222.471871:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471877:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471893:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471899:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471905:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471910:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098222.471913:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471919:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471926:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7207e92b00) 00010000:00010000:3.0:1787098222.471928:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098222.471931:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471945:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.471997:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144b94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287536 expref: 53 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.472010:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287536 expref: 52 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098222.472018:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203ead800) 00010000:00010000:3.0:1787098222.472020:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098222.472023:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7c00, rc 0) 00000100:00100000:3.0:1787098222.472094:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10470:x1873908059902208:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 664us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098222.472102:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000040:00080000:0.0:1787098222.992474:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787098222.992485:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787098222.992536:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787098222.992543:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787098222.993026:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098222.993180:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72416ff100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077752320:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787098222.993275:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204989180 going to sleep for 11 seconds 00000100:00100000:0.0:1787098222.998871:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72416ff100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077752320:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787098222.998875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098222.999202:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059902336 00000100:00100000:3.0:1787098222.999212:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059902336 00000100:00100000:3.0:1787098222.999369:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1787098222.999384:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10481:x1873908059902336:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787098222.999501:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10481:x1873908059902336:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 Request processed in 120us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098222.999510:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1787098223.002407:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098223.002456:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059902464 00000100:00100000:0.0:1787098223.002468:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059902464 00000100:00100000:0.0:1787098223.002545:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:0.0:1787098223.002559:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10481:x1873908059902464:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787098223.002604:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787098223.002773:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10481:x1873908059902464:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 216us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098223.002782:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:0.0:1787098223.009304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098223.009464:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059902592 00000100:00100000:2.0:1787098223.009478:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059902592 00000100:00100000:2.0:1787098223.009530:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1787098223.009539:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10481:x1873908059902592:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787098223.009623:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009652:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009664:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009680:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009686:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009691:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009719:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009726:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009733:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098223.009789:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787098223.009794:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098223.009808:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009819:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009834:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009840:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009845:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.009849:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009855:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009868:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:2.0:1787098223.009870:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098223.009875:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009880:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009896:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009901:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009907:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009913:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.009922:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009928:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009936:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d7203ead900) 00010000:00010000:2.0:1787098223.009939:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098223.009942:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009947:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bb7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009961:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009966:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009972:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009977:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.009980:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009985:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.009992:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203ead800) 00010000:00010000:2.0:1787098223.009994:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098223.010013:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.010019:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098223.010108:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10481:x1873908059902592:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 569us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.010116:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:0.0:1787098223.014130:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.014956:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059902848 00000100:00100000:3.0:1787098223.014970:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059902848 00000100:00100000:3.0:1787098223.015044:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:3.0:1787098223.015055:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10481:x1873908059902848:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787098223.015087:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098223.015109:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144bc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528753d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015225:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015240:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015251:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098223.015262:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787098223.015416:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015424:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015430:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015437:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098223.015442:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015449:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015462:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203ead800) 00010000:00010000:3.0:1787098223.015473:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098223.015479:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015487:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144bcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015546:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144bc5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528753d expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015557:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:3.0:1787098223.015560:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098223.015564:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144bc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528753d expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.015574:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6000, rc 0) 00000100:00100000:3.0:1787098223.015642:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10481:x1873908059902848:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 589us (1526us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787098223.015650:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:0.0:1787098223.019948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098223.020031:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059902976 00000100:00100000:2.0:1787098223.020041:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059902976 00000100:00100000:2.0:1787098223.020102:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:2.0:1787098223.020113:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10481:x1873908059902976:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787098223.020150:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787098223.020310:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10481:x1873908059902976:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 160us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.020319:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:1.0:1787098223.030854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.031021:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059903232 00000100:00100000:3.0:1787098223.031035:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059903232 00000100:00100000:3.0:1787098223.031123:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:3.0:1787098223.031135:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10481:x1873908059903232:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787098223.031165:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098223.031169:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787098223.031207:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144b86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528752f expref: 53 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.031236:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:3.0:1787098223.031262:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098223.031310:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144bda lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287544 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787098223.032438:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787098223.033449:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144be1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.033538:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.033570:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.033659:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144bda lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287544 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.033684:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287544 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.033694:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7208701400) 00010000:00010000:0.0:1787098223.033698:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098223.033701:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695000, rc 0) 00000100:00100000:0.0:1787098223.033911:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10481:x1873908059903232:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2776us (3070us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787098223.033924:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:0.0:1787098223.038579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098223.038676:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059903488 00000100:00100000:2.0:1787098223.038695:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059903488 00000100:00100000:2.0:1787098223.038783:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:2.0:1787098223.038795:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10481:x1873908059903488:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787098223.038860:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098223.038892:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144be1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287544 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.038915:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7208701400) 00010000:00010000:2.0:1787098223.038926:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098223.038963:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.038992:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039116:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039132:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039139:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039145:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039227:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039234:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039240:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039245:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.039249:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039257:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.039266:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098223.040774:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098223.040785:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.040796:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144bef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.040820:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.040826:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.040832:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.040838:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.040841:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.040849:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.040863:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa3a1c27f (ffff8d7203ead900) 00010000:00010000:2.0:1787098223.040866:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098223.040869:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.040874:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144bf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa3a1c27f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098223.042621:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10481:x1873908059903488:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 3814us (4042us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787098223.042647:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:1.0:1787098223.048007:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098223.048088:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059903616 00000100:00100000:2.0:1787098223.048105:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059903616 00000100:00100000:2.0:1787098223.048189:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:2.0:1787098223.048201:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10481:x1873908059903616:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098223.048224:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098223.048249:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528754b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.048337:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.048362:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.048374:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.048497:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144bfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528754b expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.048518:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528754b expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.048528:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:2.0:1787098223.048531:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787098223.048534:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623400, rc 0) 00000100:00100000:2.0:1787098223.048611:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10481:x1873908059903616:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 411us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.048627:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:1.0:1787098223.054273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.054566:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059903872 00000100:00100000:3.0:1787098223.054579:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059903872 00000100:00100000:3.0:1787098223.054657:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:3.0:1787098223.054668:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10481:x1873908059903872:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787098223.054973:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.054994:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.055008:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787098223.055849:0:6853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787098223.055865:0:6853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321311584860ns, next at 322311581450ns, rc = 0 00000004:00010000:3.0:1787098223.055982:0:6853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000433a9eb6 reply state 0000000031368e38 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098223.055994:0:6853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787098223.056211:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10481:x1873908059903872:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1540us (1948us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787098223.056221:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:1.0:1787098223.061703:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098223.062462:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059904000 00000100:00100000:0.0:1787098223.062478:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059904000 00010000:00010000:2.0:1787098223.062560:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.062568:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00010000:00010000:2.0:1787098223.062586:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.062587:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10481:x1873908059904000:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098223.062612:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.062620:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.062625:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.062633:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.062637:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098223.062654:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:2.0:1787098223.062660:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787098223.062666:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.062669:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287552 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.062676:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144c0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.062766:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287552 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.062812:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287552 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.062836:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:0.0:1787098223.062839:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098223.062843:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695e00, rc 0) 00000100:00100000:0.0:1787098223.062925:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10481:x1873908059904000:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 341us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098223.062934:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:1.0:1787098223.071232:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098223.071393:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059904128 00000100:00100000:0.0:1787098223.071408:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059904128 00000100:00100000:0.0:1787098223.071835:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:0.0:1787098223.071847:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2372:x1873908059904128:12345-192.168.204.51@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787098223.073015:0:6703:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1787098223.073058:0:6703:0:(genops.c:1406:class_connect()) connect: client 530d6019-f48b-45e0-97e8-95fbd128e52b, cookie 0xb1d871f9b0144c19 00002000:00100000:0.0:1787098223.073074:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 530d6019-f48b-45e0-97e8-95fbd128e52b/ffff8d710499a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787098223.073104:0:6703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787098223.073458:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787098223.073501:0:6703:0:(import.c:65:import_set_state_nolock()) ffff8d723b44f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098223.073603:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2372:x1873908059904128:12345-192.168.204.51@tcp:8:lhsmtool_posix.0 Request processed in 1755us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098223.073615:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1787098223.077402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098223.077544:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059904256 00000100:00100000:1.0:1787098223.077561:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059904256 00000100:00100000:1.0:1787098223.077662:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1787098223.077676:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:0:x1873908059904256:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787098223.078100:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1787098223.135335:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000001:00080000:0.0:1787098223.135442:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1787098223.138240:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+5:0:x1873908059904256:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 60551us (60831us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787098223.138264:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1787098223.150862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098223.151616:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059904512 00000100:00100000:0.0:1787098223.151631:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059904512 00000100:00100000:0.0:1787098223.152247:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1787098223.152261:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10481:x1873908059904512:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787098223.152642:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+57:10481:x1873908059904512:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 383us (1798us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787098223.152652:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1787098223.156761:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098223.156839:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059904768 00000100:00100000:2.0:1787098223.156855:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059904768 00000100:00100000:2.0:1787098223.156978:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:2.0:1787098223.156989:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+57:10481:x1873908059904768:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787098223.157163:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+57:10481:x1873908059904768:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 177us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.157171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:1.0:1787098223.170594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.171026:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059904896 00000100:00100000:3.0:1787098223.171048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059904896 00000100:00100000:3.0:1787098223.171135:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:3.0:1787098223.171147:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+57:10481:x1873908059904896:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787098223.171173:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098223.171202:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144c20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287559 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.171365:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.171384:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.171420:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098223.171472:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098223.171496:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.171529:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144c20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287559 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.171551:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287559 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.171560:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:3.0:1787098223.171564:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787098223.171568:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7600, rc 0) 00000100:00100000:3.0:1787098223.171649:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+58:10481:x1873908059904896:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 504us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098223.171666:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:0.0:1787098223.181264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098223.181451:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059905024 00000100:00100000:2.0:1787098223.181464:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059905024 00000100:00100000:2.0:1787098223.181538:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1787098223.181550:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059905024:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098223.181574:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098223.181599:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287560 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098223.181631:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a84f46f, blocks: 0x1 00010000:00010000:2.0:1787098223.181656:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:2.0:1787098223.181662:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098223.181673:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287560 expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.181695:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287560 expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.181712:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623e00, rc 0) 00000100:00100000:2.0:1787098223.181783:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059905024:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 235us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.181791:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:3.0:1787098223.191684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098223.191966:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059905280 00000100:00100000:1.0:1787098223.191979:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059905280 00000100:00100000:1.0:1787098223.192059:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:1.0:1787098223.192071:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+58:10481:x1873908059905280:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787098223.192233:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+58:10481:x1873908059905280:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 164us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098223.192243:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:1.0:1787098223.206456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.206557:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059905408 00000100:00100000:3.0:1787098223.206571:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059905408 00000100:00100000:3.0:1787098223.206674:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1787098223.206686:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:10481:x1873908059905408:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787098223.206710:0:6860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098223.206739:0:6860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287567 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.206778:0:6860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287560 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.206788:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098223.206793:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098223.206799:0:6860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 7 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.206839:0:6860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287560 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.206854:0:6860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287560 expref: 7 pid: 6701 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098223.206870:0:6860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6860:1873908077752448:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098223.206994:0:6860:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723b989cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098223.209912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098223.210120:0:6860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6860:1873908077752448:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098223.210172:0:6860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 7 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.210198:0:6860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6400, rc 0) 00000100:00100000:2.0:1787098223.210273:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:10481:x1873908059905408:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3588us (4024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098223.211073:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059905536 00000100:00100000:0.0:1787098223.211085:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059905536 00010000:00010000:0.0:1787098223.211132:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287560 expref: 8 pid: 6701 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.211185:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:0.0:1787098223.211197:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d721fa99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2374:x1873908059905536:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098223.211213:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098223.211243:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287560 expref: 8 pid: 6701 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.211545:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287560 expref: 8 pid: 6701 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.211592:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144c2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287560 expref: 8 pid: 6701 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.211613:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098223.211619:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098223.211628:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 7 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.211639:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 7 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.211685:0:11178:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 7 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.211704:0:11178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227487100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11178:1873908077752576:192.168.204.51@tcp:105: 00000100:00100000:0.0:1787098223.211805:0:11178:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204989e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787098223.211883:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1787098223.220949:0:11178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227487100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11178:1873908077752576:192.168.204.51@tcp:105: 00010000:00010000:2.0:1787098223.220983:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098223.221064:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d721fa99450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059905536:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 9868us (11166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.221078:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:0.0:1787098223.221201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098223.221914:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059905664 00000100:00100000:2.0:1787098223.221926:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059905664 00002000:00100000:2.0:1787098223.222071:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d7227485500 x1873908059905664/t0(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:399/0 lens 504/0 e 0 to 0 dl 1787098234 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787098223.222084:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7227485500 with x1873908059905664 ext(0->8) 00002000:00010000:2.0:1787098223.222091:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d7227485500 00000100:00100000:2.0:1787098223.222126:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1787098223.222137:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059905664:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787098223.223858:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2374:x1873908059905664:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 1712us (2647us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787098223.223875:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00002000:00100000:2.0:1787098223.223887:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d7227485500 x1873908059905664/t4294967302(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:399/0 lens 504/448 e 0 to 0 dl 1787098234 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787098223.223912:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7227485500 with x1873908059905664 ext(0->8) 00002000:00010000:2.0:1787098223.223919:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d7227485500 00000100:00100000:0.0:1787098223.228948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.229010:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059905792 00000100:00100000:3.0:1787098223.229023:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059905792 00000100:00100000:3.0:1787098223.229113:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:3.0:1787098223.229126:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+58:10481:x1873908059905792:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787098223.253588:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077752704:0@lo:400:kworker.0 00000100:00100000:3.0:1787098223.253695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098223.253747:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077753216:0@lo:400:kworker.0 00000100:00100000:3.0:1787098223.253778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098223.253809:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787098223.253817:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077752832:0@lo:400:kworker.0 00000100:00100000:3.0:1787098223.253839:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098223.253859:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077753344:0@lo:400:kworker.0 00000100:00100000:3.0:1787098223.253883:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098223.253910:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077752960:0@lo:400:kworker.0 00000100:00100000:3.0:1787098223.253938:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098223.253959:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098223.253965:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077753088:0@lo:400:kworker.0 00000100:00100000:3.0:1787098223.253988:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098223.254023:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077753216 00000100:00100000:3.0:1787098223.254032:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077753216 00000100:00100000:1.0:1787098223.254604:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077752704 00000100:00100000:1.0:1787098223.254611:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077752704 00000100:00100000:1.0:1787098223.254671:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787098223.254682:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077752704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098223.254759:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077752704:12345-0@lo:400:kworker.0 Request processed in 78us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098223.254767:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787098223.254812:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077752832 00000100:00100000:1.0:1787098223.254816:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077752832 00000100:00100000:3.0:1787098223.256100:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077752960 00000100:00100000:3.0:1787098223.256115:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077752960 00000100:00100000:1.0:1787098223.258397:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787098223.258421:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077753216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098223.258545:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077753216:12345-0@lo:400:kworker.0 Request processed in 135us (4765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098223.258553:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787098223.258579:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787098223.258586:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098223.258622:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077752832:12345-0@lo:400:kworker.0 Request processed in 37us (4782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098223.258639:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787098223.258718:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077752832:0@lo:400:kworker.0 00000100:00100000:1.0:1787098223.258735:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077752704:0@lo:400:kworker.0 00000100:00100000:1.0:1787098223.258746:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077753216:0@lo:400:kworker.0 00000100:00100000:2.0:1787098223.259571:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077753344 00000100:00100000:2.0:1787098223.259585:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077753344 00000100:00100000:2.0:1787098223.259790:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077753088 00000100:00100000:2.0:1787098223.259794:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077753088 00000100:00100000:2.0:1787098223.259827:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787098223.259837:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1873908077753344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098223.259928:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1873908077753344:12345-0@lo:400:kworker.0 Request processed in 91us (6042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.259936:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787098223.259957:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787098223.259964:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077753088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098223.260004:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077753088:12345-0@lo:400:kworker.0 Request processed in 40us (6015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.260010:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787098223.260335:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077753344:0@lo:400:kworker.0 00000100:00100000:3.0:1787098223.262052:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787098223.262481:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077752960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098223.262606:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077752960:12345-0@lo:400:kworker.0 Request processed in 541us (8666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098223.262615:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1787098223.262654:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787098223.262662:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787098223.262667:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098223.262768:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077753088:0@lo:400:kworker.0 00000100:00100000:3.0:1787098223.262782:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077752960:0@lo:400:kworker.0 00000040:00080000:1.0:1787098223.290914:0:12014:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098223.290928:0:12014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098223.290976:0:12014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787098223.290982:0:12014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787098223.296429:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+58:10481:x1873908059905792:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 67291us (67480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.296447:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000001:00080000:0.0:1787098223.298020:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787098223.298081:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787098223.302854:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.303322:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d71048ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077753472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787098223.303404:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787098223.303502:0:5866:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d72048b9a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787098223.303509:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d7204999f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d72048b9b40 00000020:00080000:0.0:1787098223.303512:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d7204999b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7241c56800 00000004:00080000:0.0:1787098223.303580:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787098223.303927:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787098223.304107:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787098223.307641:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059905920 00000100:00100000:2.0:1787098223.307667:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059905920 00000100:00100000:2.0:1787098223.307750:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077753472 00000100:00100000:2.0:1787098223.307754:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077753472 00000100:00100000:2.0:1787098223.307787:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:2.0:1787098223.307798:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059905920:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787098223.308958:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787098223.308980:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1873908077753472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787098223.309009:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787098223.309053:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a84f46c, atime: 0x6a84f46c, ctime: 0x6a84f46c, blocks: 0xb 00010000:00010000:0.0:1787098223.309138:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.309164:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:0.0:1787098223.309171:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098223.309180:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.309200:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.309213:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.309221:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.309250:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787098223.309584:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077753600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787098223.309689:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098223.309793:0:6860:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787098223.309804:0:6860:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1787098223.311986:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077753600 00000100:00100000:2.0:1787098223.312007:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077753600 00000100:00100000:2.0:1787098223.312173:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787098223.312185:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077753600:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787098223.312669:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098223.312681:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.312698:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098223.312703:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.312716:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.312744:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.312752:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.312791:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098223.312794:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098223.312796:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098223.317594:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1873908077753472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8614us (14179us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787098223.317614:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787098223.318683:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d71048ad500/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787098223.318696:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d71048ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077753472:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1787098223.319620:0:12017:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787098223.319626:0:12017:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787098223 00002000:00010000:2.0:1787098223.319629:0:12017:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787098223.319632:0:12017:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787098223 -> 1787098223 00002000:00010000:2.0:1787098223.319635:0:12017:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787098223.319733:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1873908077753600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 7548us (10042us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787098223.319747:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:2.0:1787098223.319795:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7203e0ad80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787098223.319802:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077753600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787098223.403665:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059905920:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 95853us (100810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098223.403685:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000001:00080000:2.0:1787098223.403737:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787098223.417452:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.418012:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059906176 00000100:00100000:3.0:1787098223.418027:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059906176 00000100:00100000:3.0:1787098223.418127:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:3.0:1787098223.418724:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:10481:x1873908059906176:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787098223.418810:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098223.418853:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287559 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.418883:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:3.0:1787098223.418891:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098223.418934:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.418954:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.418966:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098223.422033:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8f747d3 reply state 0000000027e33859 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098223.422060:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787098223.422256:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+14:10481:x1873908059906176:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 4112us (4821us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787098223.422304:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00010000:00010000:0.0:1787098223.426926:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.426960:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.426969:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.426977:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098223.426984:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.426993:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.427015:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:0.0:1787098223.427019:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098223.427025:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.427032:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144c43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098223.433602:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098223.433819:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059906304 00000100:00100000:2.0:1787098223.433833:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059906304 00000100:00100000:2.0:1787098223.433908:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1787098223.433919:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059906304:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787098223.434226:0:6860:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787098223.434230:0:6860:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787098223 -> 1787098221 00002000:00010000:2.0:1787098223.434234:0:6860:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787098220 00002000:00010000:2.0:1787098223.434236:0:6860:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787098223 -> 1787098221 00002000:00010000:2.0:1787098223.434238:0:6860:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787098223.434424:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059906304:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 505us (836us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787098223.434434:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1787098223.441413:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.441473:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059906560 00000100:00100000:3.0:1787098223.441488:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059906560 00000100:00100000:0.0:1787098223.442059:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:0.0:1787098223.442139:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+13:10481:x1873908059906560:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787098223.442241:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.442264:0:6853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528754b expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.442312:0:6853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.442376:0:6853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528754b expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.442393:0:6853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528754b expref: 13 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.442412:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227484a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077753728:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098223.442705:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7202caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1787098223.446836:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227484a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077753728:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098223.446882:0:6853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.448124:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.448276:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059906688 00000100:00100000:3.0:1787098223.448309:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059906688 00010000:00010000:3.0:1787098223.448375:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528754b expref: 14 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098223.448422:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1787098223.448435:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+14:2374:x1873908059906688:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098223.448459:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098223.448468:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528754b expref: 14 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.448483:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528754b expref: 14 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.448513:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144c04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528754b expref: 14 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.448530:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:3.0:1787098223.448536:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.448549:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.448558:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.448609:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098223.448680:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2374:x1873908059906688:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 246us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098223.448689:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00010000:00010000:1.0:1787098223.448713:0:6853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.448727:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.448768:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.448777:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.448784:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.448792:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098223.448806:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.448816:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.448826:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:1.0:1787098223.448830:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787098223.448835:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.448842:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144c4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098223.448894:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+12:10481:x1873908059906560:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 6763us (7501us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787098223.448905:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:1.0:1787098223.454784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098223.455982:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059906816 00000100:00100000:0.0:1787098223.455999:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059906816 00000100:00100000:0.0:1787098223.456146:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1787098223.456160:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2376:x1873908059906816:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787098223.456224:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.456252:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 7 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.456317:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098223.456324:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098223.456330:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.456389:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 7 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.456406:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 7 pid: 6860 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.456426:0:6701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227487b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1873908077753856:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098223.456544:0:6701:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7202caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1787098223.466245:0:6701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227487b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1873908077753856:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098223.466311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:0.0:1787098223.466316:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098223.466743:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059906944 00000100:00100000:3.0:1787098223.466753:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059906944 00010000:00010000:3.0:1787098223.466803:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 8 pid: 6860 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098223.466851:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1787098223.466862:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059906944:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098223.466883:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098223.466916:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 8 pid: 6860 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.466930:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 8 pid: 6860 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.466968:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c410b71e/0xb1d871f9b0144c35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287567 expref: 8 pid: 6860 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.466989:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787098223.466994:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787098223.467001:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.467025:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.467055:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098223.467132:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059906944:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 271us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098223.467141:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00010000:00010000:0.0:1787098223.467370:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.467380:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.467411:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.467427:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.467436:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.467449:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098223.467455:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.467465:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.467479:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.467487:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b0144c51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.467553:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059906816:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 11396us (12784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098223.467561:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:1.0:1787098223.470931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098223.471031:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059907200 00000100:00100000:0.0:1787098223.471044:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059907200 00000100:00100000:0.0:1787098223.471151:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:0.0:1787098223.471172:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+12:10481:x1873908059907200:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787098223.471320:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.471355:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.471370:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.471745:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.471758:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287552 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.471768:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.471814:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287552 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.471831:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287552 expref: 13 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.471849:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227487b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077753984:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098223.472008:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787098223.475484:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098223.475572:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227487b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077753984:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098223.475616:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098223.475702:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059907328 00000100:00100000:3.0:1787098223.475711:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059907328 00010000:00010000:3.0:1787098223.475758:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287552 expref: 14 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098223.475806:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:3.0:1787098223.475817:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+14:2373:x1873908059907328:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098223.475837:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098223.475847:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287552 expref: 14 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.475861:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287552 expref: 14 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.475890:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144c12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287552 expref: 14 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.475911:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:3.0:1787098223.475924:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.475936:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.475943:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098223.476085:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098223.476155:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2373:x1873908059907328:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 338us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098223.476164:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00010000:00010000:0.0:1787098223.476224:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.476232:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787098223.477773:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787098223.478150:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787098223.478210:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787098223.478610:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d71048af480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1873908077754112:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787098223.478696:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098223.478777:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7202c5b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787098223.478833:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077754112 00000100:00100000:3.0:1787098223.478843:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077754112 00000100:00100000:3.0:1787098223.478940:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787098223.478953:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1873908077754112:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787098223.479081:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1873908077754112:12345-0@lo:1000:mdt00_001.0 Request processed in 131us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098223.479091:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787098223.479177:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d71048af480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1873908077754112:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787098223.479792:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787098223.479874:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d71048af480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1873908077754240:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787098223.479935:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098223.480631:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209e99480 going to sleep for 11 seconds 00000100:00100000:0.0:1787098223.480724:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077754240 00000100:00100000:0.0:1787098223.480732:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077754240 00000100:00100000:0.0:1787098223.480775:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787098223.480786:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1873908077754240:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787098223.481052:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1873908077754240:12345-0@lo:1000:mdt00_001.0 Request processed in 267us (1116us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787098223.481061:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787098223.481816:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d71048af480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1873908077754240:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787098223.481874:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.481888:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.481899:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.481907:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.481913:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.481924:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.481948:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7203eade00) 00010000:00010000:2.0:1787098223.481952:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098223.481959:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.481980:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144c5f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482032:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482040:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482046:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482053:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.482057:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482064:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482075:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203ead800) 00010000:00010000:2.0:1787098223.482078:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098223.482081:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482086:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144b8d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482114:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482131:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287536 expref: 16 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482147:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482353:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287536 expref: 16 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.482374:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287536 expref: 16 pid: 6853 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098223.482391:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077754368:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098223.482509:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241ac2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787098223.495534:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077754368:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098223.495587:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098223.498042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098223.498203:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059907456 00000100:00100000:0.0:1787098223.498218:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059907456 00010000:00010000:0.0:1787098223.498270:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287536 expref: 17 pid: 6853 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098223.498332:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:0.0:1787098223.498354:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+17:2374:x1873908059907456:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098223.498376:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098223.498384:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287536 expref: 17 pid: 6853 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.498421:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287536 expref: 17 pid: 6853 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.498451:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ba9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287536 expref: 17 pid: 6853 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.498476:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203ead800) 00010000:00010000:0.0:1787098223.498482:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.498494:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.498503:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.498542:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098223.498620:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+16:2374:x1873908059907456:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 278us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098223.498628:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00010000:00010000:2.0:1787098223.498730:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498740:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498755:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498763:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498771:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498798:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.498803:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498812:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498823:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203ead800) 00010000:00010000:2.0:1787098223.498826:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098223.498831:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498837:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144c66 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498850:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498857:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498864:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498868:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098223.498871:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498877:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498897:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203ead800) 00010000:00010000:2.0:1787098223.498900:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787098223.498903:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098223.498909:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144c58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098223.499255:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+15:10481:x1873908059907200:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 28085us (28336us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787098223.499266:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000020:00080000:2.0:1787098223.499271:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787098223.505765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098223.505842:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059907712 00000100:00100000:3.0:1787098223.505856:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059907712 00000100:00100000:3.0:1787098223.505930:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1787098223.505943:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+15:10481:x1873908059907712:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1787098223.505993:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098223.505999:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098223.506036:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787098223.506045:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:3.0:1787098223.506944:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787098223.511225:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787098223.511620:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.511655:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.511671:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.511681:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.511689:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.511697:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098223.511730:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787098223.511907:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+17:10481:x1873908059907712:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 5960us (6149us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787098223.511921:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000020:00080000:1.0:1787098223.511931:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787098223.512763:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098223.512776:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.512789:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098223.512794:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.512805:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.512833:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:0.0:1787098223.512836:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787098223.512843:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.512849:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144c6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098223.512870:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098223.512872:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098223.512874:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098223.761211:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077754496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098223.761380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098223.761619:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077754496 00000100:00100000:3.0:1787098223.761631:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077754496 00000100:00100000:3.0:1787098223.761714:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787098223.761726:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1873908077754496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787098223.761793:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098223.761870:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1873908077754496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098223.761879:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787098223.762016:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077754496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787098224.015608:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098225.039535:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787098225.384858:0:12067:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098225.384870:0:12067:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098225.384914:0:12067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787098225.384923:0:12067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787098225.551566:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098225.551578:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098225.551618:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787098225.551628:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787098225.581348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098225.581744:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059907968 00000100:00100000:1.0:1787098225.581759:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059907968 00000100:00100000:1.0:1787098225.581878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:1.0:1787098225.581892:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+17:10500:x1873908059907968:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1787098225.581926:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098225.581955:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144c74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528756e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098225.582610:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0144c7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098225.582631:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0144c7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098225.582647:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0144c7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098225.582661:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000100:00080000:3.0:1787098225.582954:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787098225.586590:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144c74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528756e expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098225.586646:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0144c7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528756e expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098225.586656:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:1.0:1787098225.586659:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787098225.586664:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412400, rc 0) 00000100:00100000:1.0:1787098225.586766:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+19:10500:x1873908059907968:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 4877us (5430us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787098225.587922:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:1.0:1787098225.604788:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098225.610450:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059908096 00000100:00100000:2.0:1787098225.610472:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059908096 00000100:00100000:2.0:1787098225.610623:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:2.0:1787098225.610637:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+19:10500:x1873908059908096:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1787098225.610750:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.610773:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.610787:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.610819:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.610827:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.610851:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611221:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611231:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611239:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787098225.611337:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611353:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611361:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611368:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611376:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098225.611381:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611390:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611405:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098225.611414:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098225.611420:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611427:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144c89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611442:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611448:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611455:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611460:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098225.611464:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611470:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611477:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7203eade00) 00010000:00010000:2.0:1787098225.611480:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098225.611482:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611488:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144c90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611502:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611515:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611521:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611526:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098225.611529:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611536:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611544:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eada00) 00010000:00010000:2.0:1787098225.611546:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098225.611549:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.611554:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144c97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098225.611672:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+19:10500:x1873908059908096:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1034us (6897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098225.611681:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:0.0:1787098225.687700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098225.687773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098225.687803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098225.687850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098225.687894:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059908608 00000100:00100000:0.0:1787098225.687907:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059908608 00000100:00100000:0.0:1787098225.687994:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:0.0:1787098225.688007:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2374:x1873908059908608:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098225.688104:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2374:x1873908059908608:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 100us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098225.688114:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00080000:0.0:1787098225.688141:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098225.688237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059908224 00000100:00100000:1.0:1787098225.688242:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059908224 00000100:00100000:1.0:1787098225.688275:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 279 00000100:00100000:1.0:1787098225.688317:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059908224:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098225.688350:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059908224:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098225.688358:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 279 00000100:00100000:3.0:1787098225.688687:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059908480 00000100:00100000:3.0:1787098225.688693:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059908480 00000100:00100000:3.0:1787098225.688743:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059908352 00000100:00100000:3.0:1787098225.688746:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059908352 00000100:00100000:3.0:1787098225.688783:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1787098225.688792:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059908480:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098225.688836:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059908480:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 46us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098225.688842:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1787098225.688856:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:3.0:1787098225.688862:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059908352:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098225.688890:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059908352:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098225.688896:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00080000:1.0:1787098225.689382:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098225.689386:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787098225.701024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098225.701097:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059908864 00000100:00100000:3.0:1787098225.701111:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059908864 00000100:00100000:3.0:1787098225.701192:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:3.0:1787098225.701203:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+19:10503:x1873908059908864:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098225.701233:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098225.701334:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287575 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.701445:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.701464:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.701478:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.701497:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.701504:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.701511:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.701941:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.701951:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702117:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098225.702131:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787098225.702258:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702277:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702330:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702338:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098225.702344:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702353:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702370:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:3.0:1787098225.702373:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098225.702379:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702385:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144ca5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702406:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702413:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702419:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702424:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098225.702433:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702439:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702447:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7207e92f00) 00010000:00010000:3.0:1787098225.702450:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098225.702453:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702459:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702515:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287575 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702531:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287575 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.702539:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098225.702541:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098225.702544:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7c00, rc 0) 00000100:00100000:3.0:1787098225.702639:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+21:10503:x1873908059908864:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1437us (1629us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787098225.702649:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:3.0:1787098225.708503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098225.709034:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059908992 00000100:00100000:0.0:1787098225.709048:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059908992 00000100:00100000:0.0:1787098225.709153:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:0.0:1787098225.709165:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+21:10503:x1873908059908992:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1787098225.709260:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.709328:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.709790:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.709835:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.709843:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.709852:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.709859:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098225.709864:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.709872:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.709888:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098225.709892:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787098225.709898:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.709922:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098225.710093:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+21:10503:x1873908059908992:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 928us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098225.710103:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:1.0:1787098225.721205:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098225.723186:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059909248 00000100:00100000:0.0:1787098225.723208:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059909248 00000100:00100000:0.0:1787098225.723329:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1787098225.723342:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+21:10503:x1873908059909248:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1787098225.723747:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+22:10503:x1873908059909248:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 407us (2557us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787098225.723757:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1787098225.772762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098225.772835:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059909504 00000100:00100000:3.0:1787098225.772849:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059909504 00000100:00100000:3.0:1787098225.772947:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:3.0:1787098225.772988:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+22:10024:x1873908059909504:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1787098225.773032:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098225.773063:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144cc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528757c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.773203:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.773222:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287575 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.773232:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.773275:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287575 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.773347:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287575 expref: 23 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098225.773363:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077754624:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098225.773547:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723b455840 going to sleep for 11 seconds 00000100:00100000:2.0:1787098225.777756:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077754624:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098225.777810:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098225.783211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098225.784307:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059909632 00000100:00100000:3.0:1787098225.784322:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059909632 00010000:00010000:3.0:1787098225.784381:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287575 expref: 24 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098225.784433:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1787098225.784445:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+24:2374:x1873908059909632:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098225.784486:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098225.784496:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287575 expref: 24 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.784513:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287575 expref: 24 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.784545:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144cb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287575 expref: 24 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.784565:0:11681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098225.784571:0:11681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.784581:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.784589:0:11681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098225.784631:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098225.784704:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+23:2374:x1873908059909632:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 260us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098225.784714:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00010000:00010000:1.0:1787098225.785901:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098225.785919:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098225.785963:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787098225.786169:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144cc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528757c expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098225.786196:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528757c expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098225.786206:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098225.786209:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787098225.786213:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7000, rc 0) 00000100:00100000:1.0:1787098225.786343:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+23:10024:x1873908059909504:12345-192.168.204.51@tcp:101:bash.0 Request processed in 13357us (13600us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787098225.786352:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:1.0:1787098225.791093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098225.791174:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059909888 00000100:00100000:2.0:1787098225.791201:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059909888 00000100:00100000:2.0:1787098225.791460:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:2.0:1787098225.791473:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+23:10024:x1873908059909888:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:2.0:1787098225.791847:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.791868:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.791882:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098225.791939:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787098225.791962:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec0a3865 reply state 00000000e7591618 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098225.791972:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787098225.792013:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787098225.792356:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+27:10024:x1873908059909888:12345-192.168.204.51@tcp:36:bash.0 Request processed in 883us (1273us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787098225.792364:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000020:00080000:2.0:1787098225.792371:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787098225.804452:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098225.805195:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059910016 00000100:00100000:0.0:1787098225.805211:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059910016 00000100:00100000:0.0:1787098225.805344:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:0.0:1787098225.805355:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+27:10024:x1873908059910016:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098225.805389:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098225.805568:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144ce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287583 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.805658:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287583 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.805677:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287583 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.805735:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098225.805740:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098225.805743:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695e00, rc 0) 00000100:00100000:0.0:1787098225.805973:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+28:10024:x1873908059910016:12345-192.168.204.51@tcp:101:bash.0 Request processed in 619us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098225.805981:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:0.0:1787098225.807776:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077754752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098225.807873:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098225.807961:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077754752 00000100:00100000:0.0:1787098225.807971:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077754752 00000100:00100000:0.0:1787098225.808057:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787098225.808068:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1873908077754752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098225.808113:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098225.808168:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1873908077754752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098225.808177:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787098225.808207:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098225.808248:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077754752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787098225.810906:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.810931:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.810940:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.810947:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098225.810968:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.810978:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.811000:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098225.811003:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098225.811009:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098225.811015:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144cdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098225.812582:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098225.812683:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059910144 00000100:00100000:0.0:1787098225.812696:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059910144 00000100:00100000:0.0:1787098225.812893:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:0.0:1787098225.812905:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:10024:x1873908059910144:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098225.812930:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098225.812960:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528758a expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098225.813010:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a84f46d, atime: 0x6a84f46c, ctime: 0x6a84f46d, blocks: 0xb 00010000:00010000:0.0:1787098225.813038:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1787098225.813043:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098225.813054:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528758a expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.813076:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528758a expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.813091:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695200, rc 0) 00000100:00100000:0.0:1787098225.813179:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:10024:x1873908059910144:12345-192.168.204.51@tcp:101:bash.0 Request processed in 275us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098225.813186:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1787098225.819688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098225.819903:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059910272 00000100:00100000:3.0:1787098225.819917:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059910272 00002000:00010000:3.0:1787098225.819974:0:6707:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787098225.819980:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d71048ad880 with x1873908059910272 ext(0->18446744073709551615) 00002000:00010000:3.0:1787098225.820016:0:6707:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d71048ad880. 00000100:00100000:3.0:1787098225.820136:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1787098225.820149:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059910272:12345-192.168.204.51@tcp:10:bash.0 00002000:00010000:2.0:1787098225.822001:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787098225.822011:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787098221 -> 1787098225 00002000:00010000:2.0:1787098225.822015:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787098220 -> 1787098220 00002000:00010000:2.0:1787098225.822017:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787098221 -> 1787098225 00002000:00010000:2.0:1787098225.822086:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787098225.822242:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059910272:12345-192.168.204.51@tcp:10:bash.0 Request processed in 2089us (2557us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787098225.822255:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00010000:2.0:1787098225.822262:0:6707:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787098225.822265:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d71048ad880 with x1873908059910272 ext(0->18446744073709551615) 00002000:00010000:2.0:1787098225.822272:0:6707:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d71048ad880. 00000001:00080000:1.0:1787098225.855327:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1787098225.964092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098225.964220:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059910400 00000100:00100000:0.0:1787098225.964235:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059910400 00000100:00100000:0.0:1787098225.964363:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1787098225.964376:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+27:10517:x1873908059910400:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1787098225.964490:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.964512:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.964526:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.964565:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.964573:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.964579:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.964946:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.964956:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.964963:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787098225.965014:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965028:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965035:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965042:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965048:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098225.965052:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965066:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965080:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:0.0:1787098225.965084:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098225.965094:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965099:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144cf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965114:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965119:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965125:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965129:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098225.965132:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965137:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965143:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7208701600) 00010000:00010000:0.0:1787098225.965146:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098225.965148:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965166:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965183:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965188:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965194:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965198:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098225.965202:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965207:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965215:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098225.965217:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098225.965219:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098225.965225:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098225.965437:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+27:10517:x1873908059910400:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1060us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098225.965448:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1787098226.035358:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098226.035452:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059910656 00000100:00100000:1.0:1787098226.035465:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059910656 00000100:00100000:1.0:1787098226.035544:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:1.0:1787098226.035732:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+27:10520:x1873908059910656:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1787098226.035764:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098226.035795:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144d07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287591 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.035929:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.036143:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.036160:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.036182:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.036190:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.036197:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.039064:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144d1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.039091:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040251:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098226.040312:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787098226.040807:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040818:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040844:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040851:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098226.040856:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040865:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040882:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:1.0:1787098226.040886:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098226.040891:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040897:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144d0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040915:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040922:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040928:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040933:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098226.040936:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040952:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040962:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7208d7f100) 00010000:00010000:1.0:1787098226.040965:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098226.040969:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.040975:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.041224:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144d07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287591 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.041244:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287591 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.041252:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098226.041255:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787098226.041257:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412c00, rc 0) 00000100:00100000:1.0:1787098226.041728:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+29:10520:x1873908059910656:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 6171us (6395us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787098226.041742:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:3.0:1787098226.049198:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.049362:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059910784 00000100:00100000:0.0:1787098226.049377:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059910784 00000100:00100000:0.0:1787098226.049450:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:0.0:1787098226.049462:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+29:10520:x1873908059910784:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1787098226.049561:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.049584:0:6853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528757c expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.049594:0:6853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.049641:0:6853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528757c expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.049658:0:6853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528757c expref: 29 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098226.049676:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227487800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077754880:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098226.053199:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206417840 going to sleep for 11 seconds 00000100:00100000:0.0:1787098226.058882:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227487800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077754880:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098226.058926:0:6853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098226.062255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.065186:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059911040 00000100:00100000:2.0:1787098226.065212:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059911040 00000100:00100000:2.0:1787098226.065329:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1787098226.065343:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+30:5610:x1873908059911040:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787098226.065832:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+31:5610:x1873908059911040:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 491us (3589us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787098226.065841:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00010000:00010000:0.0:1787098226.066134:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098226.069454:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.071254:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059911168 00000100:00100000:2.0:1787098226.071274:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059911168 00010000:00010000:2.0:1787098226.071387:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528757c expref: 31 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098226.071437:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1787098226.071450:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+31:2373:x1873908059911168:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098226.071472:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098226.071481:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528757c expref: 31 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.071498:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528757c expref: 31 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.071530:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144ccf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528757c expref: 31 pid: 5844 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.071555:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098226.071561:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.071574:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.071583:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.071649:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098226.071726:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+30:2373:x1873908059911168:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 278us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098226.071735:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00010000:00010000:3.0:1787098226.072266:0:6853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.072315:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.072361:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.072369:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.072377:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.072384:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098226.072389:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.072398:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.072410:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098226.072413:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098226.072418:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.072440:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144d2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098226.072519:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+29:10520:x1873908059910784:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 23057us (23336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098226.072530:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:3.0:1787098226.078610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.078910:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059911424 00000100:00100000:0.0:1787098226.078956:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059911424 00000100:00100000:0.0:1787098226.079087:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1787098226.079100:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+29:10520:x1873908059911424:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1787098226.079522:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+30:10520:x1873908059911424:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 423us (920us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787098226.079531:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1787098226.208098:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.208369:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059911680 00000100:00100000:0.0:1787098226.208385:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059911680 00000100:00100000:1.0:1787098226.208515:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:1.0:1787098226.208530:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+30:10531:x1873908059911680:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1787098226.208599:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098226.208630:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0144d31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287598 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.208730:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.208748:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.208762:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.208782:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.208790:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.208798:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.209240:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144d46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.209251:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.209258:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098226.209270:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787098226.210174:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210189:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210197:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210205:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098226.210210:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210219:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210236:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:1.0:1787098226.210240:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098226.210245:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210252:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0144d38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210269:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210276:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210346:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210352:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098226.210366:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210373:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.210382:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7208d7f100) 00010000:00010000:1.0:1787098226.210385:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098226.210389:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.212149:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0144d3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.212265:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0144d31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287598 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.212310:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287598 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.212320:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098226.212323:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787098226.212326:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412000, rc 0) 00000100:00100000:1.0:1787098226.213073:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+32:10531:x1873908059911680:12345-192.168.204.51@tcp:101:cat.0 Request processed in 4542us (4982us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787098226.213087:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:1.0:1787098226.226185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.226668:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059911936 00000100:00100000:2.0:1787098226.226683:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059911936 00000100:00100000:2.0:1787098226.226775:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1787098226.226787:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+32:10531:x1873908059911936:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:2.0:1787098226.227143:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+33:10531:x1873908059911936:12345-192.168.204.51@tcp:35:cat.0 Request processed in 358us (973us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787098226.227153:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:3.0:1787098226.251884:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.252007:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059912192 00000100:00100000:2.0:1787098226.252023:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059912192 00000100:00100000:2.0:1787098226.252101:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:2.0:1787098226.252114:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+33:10532:x1873908059912192:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:2.0:1787098226.252195:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787098226.252231:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0144d46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287598 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252259:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0144d1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287591 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252274:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287583 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252332:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098226.252371:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098226.252401:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252416:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252430:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252446:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252453:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252460:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252863:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252873:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.252881:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787098226.253616:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787098226.253629:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324509348034ns, next at 325509345226ns, rc = 0 00010000:00010000:2.0:1787098226.253703:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253726:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253735:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253744:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253751:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253758:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253791:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098226.253820:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253826:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253833:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253840:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098226.253845:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253854:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253879:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eada00) 00010000:00010000:2.0:1787098226.253882:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787098226.253887:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253894:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144d62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253918:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253925:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253931:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253936:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098226.253939:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253946:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253953:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098226.253956:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098226.253959:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.253965:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144d54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787098226.253986:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001396cf30 reply state 000000007d00d4ed transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098226.253997:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787098226.254024:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098226.254034:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.254056:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098226.254062:0:6716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.254070:0:6716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.254081:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d7203eada00) 00010000:00010000:1.0:1787098226.254083:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787098226.254087:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.254093:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b0144d69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.254109:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098226.254111:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098226.254113:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098226.254134:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+32:10532:x1873908059912192:12345-192.168.204.51@tcp:36:rm.0 Request processed in 2018us (2259us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787098226.254145:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00010000:00010000:0.0:1787098226.258147:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.258172:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.258181:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.258189:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098226.258195:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.258203:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.258226:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7203eade00) 00010000:00010000:0.0:1787098226.258230:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098226.258236:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.258243:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0144d5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098226.341268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.341671:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059912448 00000100:00100000:0.0:1787098226.341686:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059912448 00000100:00100000:0.0:1787098226.341762:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:0.0:1787098226.341775:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+31:10538:x1873908059912448:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098226.341920:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098226.341952:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144d70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528759f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.342140:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.342157:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.342170:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.342187:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.342193:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.342198:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787098226.346590:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787098226.348260:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348337:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348351:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348419:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348427:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348435:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348442:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098226.348448:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348456:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348473:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:0.0:1787098226.348477:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098226.348482:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348488:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144d77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787098226.348507:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d110fa62 reply state 0000000029f63a12 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098226.348524:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787098226.348577:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144d70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528759f expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348595:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528759f expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.348603:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7208701000) 00010000:00010000:0.0:1787098226.348605:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098226.348607:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:0.0:1787098226.350810:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+34:10538:x1873908059912448:12345-192.168.204.51@tcp:101:bash.0 Request processed in 9021us (9540us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787098226.350827:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00010000:00010000:3.0:1787098226.357717:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.357741:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.357751:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.357758:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098226.357765:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.357774:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.357795:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7208701600) 00010000:00010000:3.0:1787098226.357799:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098226.357805:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.357838:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144d7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098226.360166:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.360333:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059912576 00000100:00100000:0.0:1787098226.360346:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059912576 00000100:00100000:0.0:1787098226.360430:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1787098226.360442:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059912576:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098226.360470:0:12017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098226.360502:0:12017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875a6 expref: -99 pid: 12017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098226.360539:0:12017:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098226.360567:0:12017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=324s v=(0 0) 00010000:00010000:0.0:1787098226.360573:0:12017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098226.360585:0:12017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875a6 expref: 6 pid: 12017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.360635:0:12017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875a6 expref: 6 pid: 12017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.360653:0:12017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695800, rc 0) 00000100:00100000:0.0:1787098226.360724:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059912576:12345-192.168.204.51@tcp:101:bash.0 Request processed in 284us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098226.360732:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1787098226.364864:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.365045:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059912704 00000100:00100000:2.0:1787098226.365059:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059912704 00000100:00100000:2.0:1787098226.365189:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:2.0:1787098226.365203:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:10538:x1873908059912704:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1787098226.365229:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098226.365255:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875ad expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.365337:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875a6 expref: 7 pid: 12017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.365349:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098226.365354:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098226.365361:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.365408:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875a6 expref: 7 pid: 12017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.365447:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875a6 expref: 7 pid: 12017 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098226.365465:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6703:1873908077755008:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098226.365596:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787098226.369139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098226.369340:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059912832 00000100:00100000:3.0:1787098226.369352:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059912832 00010000:00010000:3.0:1787098226.369414:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875a6 expref: 8 pid: 12017 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098226.369462:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:3.0:1787098226.369474:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d721fa98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059912832:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098226.369493:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098226.369526:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875a6 expref: 8 pid: 12017 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.369544:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875a6 expref: 8 pid: 12017 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.369580:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098226.369585:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098226.369595:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.369607:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.369690:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098226.369711:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1873908077755136:192.168.204.51@tcp:105: 00000100:00100000:3.0:1787098226.370597:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7202caa000 going to sleep for 11 seconds 00010000:00010000:2.0:1787098226.370725:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b0144d93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875a6 expref: 8 pid: 12017 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098226.370747:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6703:1873908077755008:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098226.370782:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.370801:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622800, rc 0) 00000100:00100000:2.0:1787098226.370864:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:10538:x1873908059912704:12345-192.168.204.51@tcp:101:bash.0 Request processed in 5663us (6014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098226.370876:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1787098226.376356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098226.376485:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1873908077755136:192.168.204.51@tcp:105: 00010000:00010000:3.0:1787098226.376521:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098226.376637:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d721fa98c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059912832:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 7164us (7512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098226.376651:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:0.0:1787098226.377624:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059913088 00000100:00100000:0.0:1787098226.377638:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059913088 00000100:00100000:0.0:1787098226.377711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1787098226.377723:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+33:10538:x1873908059913088:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:0.0:1787098226.378197:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+34:10538:x1873908059913088:12345-192.168.204.51@tcp:35:bash.0 Request processed in 475us (1856us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787098226.378206:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:3.0:1787098226.569799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.570116:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059913216 00000100:00100000:2.0:1787098226.570131:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059913216 00000100:00100000:2.0:1787098226.570216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:2.0:1787098226.570228:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+34:10554:x1873908059913216:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098226.570261:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098226.570354:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144da1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875b4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.570474:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.570490:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.570504:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098226.570583:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787098226.570587:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098226.570609:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.570639:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144da1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875b4 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.570661:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875b4 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.570670:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098226.570673:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098226.570677:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623000, rc 0) 00000100:00100000:2.0:1787098226.570748:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+35:10554:x1873908059913216:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 523us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098226.570755:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:1.0:1787098226.578365:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.578620:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059913472 00000100:00100000:2.0:1787098226.578634:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059913472 00000100:00100000:2.0:1787098226.578731:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:2.0:1787098226.578743:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+35:10554:x1873908059913472:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098226.578769:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098226.578797:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144daf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875bb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.578933:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144db6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.578950:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.578965:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144db6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098226.578978:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787098226.579165:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144daf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875bb expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.579187:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144db6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875bb expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.579197:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7208701000) 00010000:00010000:2.0:1787098226.579200:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098226.579203:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623800, rc 0) 00000100:00100000:2.0:1787098226.579406:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+37:10554:x1873908059913472:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 665us (1054us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787098226.579415:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:1.0:1787098226.585133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.585228:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059913728 00000100:00100000:2.0:1787098226.585257:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059913728 00000100:00100000:2.0:1787098226.585373:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:2.0:1787098226.585385:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+37:10554:x1873908059913728:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098226.585432:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098226.585463:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144dc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.585597:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144dcb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.585615:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144dcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.585629:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144dcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098226.585643:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787098226.585807:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0144dc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875c2 expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.585829:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144dcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875c2 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.585838:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7208701000) 00010000:00010000:2.0:1787098226.585841:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787098226.585845:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622c00, rc 0) 00000100:00100000:2.0:1787098226.585934:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+39:10554:x1873908059913728:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 550us (816us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787098226.585941:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:3.0:1787098226.590875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.590997:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059913856 00000100:00100000:0.0:1787098226.591019:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059913856 00000100:00100000:0.0:1787098226.591115:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1787098226.591128:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+39:2376:x1873908059913856:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098226.591148:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098226.591184:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0144db6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875bb expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.591210:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7208701000) 00010000:00010000:0.0:1787098226.591217:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098226.591374:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+38:2376:x1873908059913856:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 248us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098226.591383:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1787098226.597061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098226.597162:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059913984 00000100:00100000:3.0:1787098226.597175:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059913984 00000100:00100000:3.0:1787098226.597249:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:3.0:1787098226.597261:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d724118f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059913984:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:3.0:1787098226.597456:0:6860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.597483:0:6860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.597493:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098226.597499:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787098226.597517:0:6860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.597568:0:6860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.597585:0:6860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 6 pid: 6703 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098226.597602:0:6860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6860:1873908077755264:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098226.597719:0:6860:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723b455480 going to sleep for 11 seconds 00000100:00100000:3.0:1787098226.602816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.603206:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059914112 00000100:00100000:0.0:1787098226.603219:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059914112 00002000:00100000:0.0:1787098226.603345:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d7207df3b80 x1873908059914112/t0(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:402/0 lens 504/0 e 0 to 0 dl 1787098237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787098226.603358:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7207df3b80 with x1873908059914112 ext(0->8) 00010000:00010000:0.0:1787098226.603370:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 7 pid: 6703 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.603391:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 7 pid: 6703 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098226.603410:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d7207df3b80 00000100:00100000:0.0:1787098226.603442:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1787098226.603454:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059914112:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:0.0:1787098226.604843:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2374:x1873908059914112:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 1377us (2028us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787098226.604857:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00100000:0.0:1787098226.604871:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d7207df3b80 x1873908059914112/t4294967302(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:402/0 lens 504/448 e 0 to 0 dl 1787098237 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787098226.604882:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7207df3b80 with x1873908059914112 ext(0->8) 00010000:00010000:0.0:1787098226.604892:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 9 pid: 6703 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.604926:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 9 pid: 6703 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098226.604934:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d7207df3b80 00000100:00100000:2.0:1787098226.606374:0:6860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6860:1873908077755264:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098226.606424:0:6860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098226.609237:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.609549:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059914240 00000100:00100000:0.0:1787098226.609562:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059914240 00010000:00010000:0.0:1787098226.609619:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 9 pid: 6703 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098226.609670:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1787098226.609683:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2373:x1873908059914240:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098226.609704:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787098226.609731:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787098226.609735:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787098226 00002000:00010000:0.0:1787098226.609737:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787098226 00002000:00010000:0.0:1787098226.609740:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787098226 00010000:00010000:0.0:1787098226.609747:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 9 pid: 6703 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.609763:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 9 pid: 6703 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.609794:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0144d9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ad expref: 9 pid: 6703 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.609844:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098226.609849:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098226.609857:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.609868:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.609911:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098226.609985:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059914240:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 305us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098226.609994:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00010000:00010000:2.0:1787098226.610167:0:6860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.610179:0:6860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.610213:0:6860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.610223:0:6860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.610232:0:6860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.610240:0:6860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098226.610245:0:6860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.610255:0:6860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.610332:0:6860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.610341:0:6860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000632d587a/0xb1d871f9b0144dd9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098226.610407:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d724118f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059913984:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 13148us (13360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098226.610416:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:3.0:1787098226.615156:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.615265:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059914496 00000100:00100000:0.0:1787098226.615337:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059914496 00000100:00100000:0.0:1787098226.615428:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:0.0:1787098226.615441:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+38:10554:x1873908059914496:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:0.0:1787098226.615535:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144dcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875c2 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787098226.615956:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787098226.616006:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787098226.617769:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787098226.617877:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.617904:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528759f expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.617930:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.617984:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528759f expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.618000:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528759f expref: 42 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098226.618037:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227487800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1873908077755392:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098226.618500:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206417840 going to sleep for 11 seconds 00000100:00100000:3.0:1787098226.624216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.624488:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227487800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1873908077755392:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098226.624527:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098226.624860:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059914624 00000100:00100000:1.0:1787098226.624869:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059914624 00010000:00010000:1.0:1787098226.624924:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528759f expref: 43 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098226.624999:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1787098226.625119:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+43:2373:x1873908059914624:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098226.625139:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098226.625149:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528759f expref: 43 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.625163:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528759f expref: 43 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.625195:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528759f expref: 43 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.625217:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7208701000) 00010000:00010000:1.0:1787098226.625224:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.625235:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.625242:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098226.625335:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098226.625688:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+42:2373:x1873908059914624:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 571us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098226.625703:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00010000:00010000:3.0:1787098226.626502:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.626516:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787098226.626697:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787098226.626937:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1787098226.628477:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1873908077755520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787098226.628605:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098226.628644:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723b455480 going to sleep for 11 seconds 00000100:00100000:0.0:1787098226.629355:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077755520 00000100:00100000:0.0:1787098226.629367:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077755520 00000100:00100000:0.0:1787098226.629464:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787098226.629475:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1873908077755520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787098226.629596:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1873908077755520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098226.629605:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787098226.629807:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787098226.629919:0:5846:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787098226.629927:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1787098226.629955:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d71048ad500, transno 4294967301 00000100:00100000:3.0:1787098226.629999:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1873908077755520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787098226.631372:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787098226.631606:0:5846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d71048aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1873908077755648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787098226.631689:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098226.631726:0:5846:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723b455900 going to sleep for 11 seconds 00000100:00100000:0.0:1787098226.631817:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077755648 00000100:00100000:0.0:1787098226.631827:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077755648 00000100:00100000:0.0:1787098226.631893:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787098226.631904:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1873908077755648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787098226.632358:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1873908077755648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 454us (668us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787098226.632368:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787098226.632796:0:5846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d71048aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1873908077755648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787098226.632876:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787098226.632932:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.632943:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.632951:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.633103:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098226.633109:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.633118:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.633139:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7208701000) 00010000:00010000:3.0:1787098226.633142:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787098226.633149:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.633157:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144de0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787098226.633598:0:5846:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787098226.633725:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787098226.633740:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324889459017ns, next at 325889455769ns, rc = 0 00000001:00080000:3.0:1787098226.633748:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787098226.633794:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7208701000) 00010000:00010000:3.0:1787098226.633798:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787098226.633807:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144dcb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875c2 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098226.634094:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+45:10554:x1873908059914496:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 18654us (18952us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787098226.634105:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000020:00080000:3.0:1787098226.634113:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787098226.637062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.637182:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059914752 00000100:00100000:2.0:1787098226.637196:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059914752 00000100:00100000:2.0:1787098226.637426:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:2.0:1787098226.637440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+45:10554:x1873908059914752:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098226.637474:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098226.637506:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144de7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875c9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.637600:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144de7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875c9 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.637618:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144de7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875c9 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.637648:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:2.0:1787098226.637652:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098226.637675:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622e00, rc 0) 00000100:00100000:2.0:1787098226.637762:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+46:10554:x1873908059914752:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 324us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098226.637770:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:1.0:1787098226.647098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098226.647341:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059915008 00000100:00100000:3.0:1787098226.647355:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059915008 00000100:00100000:3.0:1787098226.647433:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1787098226.647446:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+46:10554:x1873908059915008:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1787098226.647966:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+47:10554:x1873908059915008:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 521us (882us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787098226.647977:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1787098226.746948:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.747152:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059915136 00000100:00100000:2.0:1787098226.747166:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059915136 00000100:00100000:2.0:1787098226.747246:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:2.0:1787098226.747257:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+47:10564:x1873908059915136:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1787098226.747482:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747506:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747525:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747546:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747553:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747560:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747692:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747702:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747733:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787098226.747792:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747807:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747813:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747821:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747828:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098226.747833:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747842:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747857:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098226.747861:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098226.747867:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747874:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144dee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747890:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747902:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747908:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747913:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098226.747916:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747922:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747930:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7203ead000) 00010000:00010000:2.0:1787098226.747932:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098226.747935:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747941:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144df5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747958:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747964:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747970:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747975:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098226.747985:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.747992:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.748374:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:2.0:1787098226.748379:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098226.748392:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.748401:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098226.748513:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+47:10564:x1873908059915136:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1254us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098226.748523:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:1.0:1787098226.803851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.804259:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059915392 00000100:00100000:0.0:1787098226.804273:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059915392 00000100:00100000:0.0:1787098226.804408:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:0.0:1787098226.804422:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+47:10567:x1873908059915392:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098226.804451:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098226.804480:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875d0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.804582:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.804601:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.804616:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.804636:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.804644:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.804651:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.804832:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.804858:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.804883:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098226.804895:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787098226.806202:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806222:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806232:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806240:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098226.806246:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806255:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806274:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:0.0:1787098226.806311:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098226.806317:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806324:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0144e0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806345:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806367:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806373:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806379:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098226.806613:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806623:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806632:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7208701400) 00010000:00010000:0.0:1787098226.806635:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098226.806640:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806646:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806715:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d0 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806732:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d0 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.806740:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098226.806743:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098226.806756:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:0.0:1787098226.806916:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+49:10567:x1873908059915392:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 2495us (3077us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787098226.806928:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:3.0:1787098226.812913:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.813156:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059915520 00000100:00100000:0.0:1787098226.813170:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059915520 00000100:00100000:0.0:1787098226.813253:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:0.0:1787098226.813265:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+49:10567:x1873908059915520:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1787098226.813408:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.813429:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.813443:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.813478:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.813487:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.813495:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.813502:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098226.813507:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.813516:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.813549:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098226.813553:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787098226.813559:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.813565:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144e26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098226.813658:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+49:10567:x1873908059915520:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 394us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098226.813668:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:2.0:1787098226.817936:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098226.818674:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059915776 00000100:00100000:3.0:1787098226.818690:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059915776 00000100:00100000:3.0:1787098226.818807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:3.0:1787098226.818840:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+49:10567:x1873908059915776:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1787098226.819251:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+50:10567:x1873908059915776:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 413us (1329us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787098226.819260:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1787098226.898087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.898198:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059916032 00000100:00100000:2.0:1787098226.898210:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059916032 00000100:00100000:2.0:1787098226.898408:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:2.0:1787098226.898421:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+50:10577:x1873908059916032:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1787098226.898457:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098226.898462:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787098226.898503:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875b4 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.898530:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098226.898537:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098226.898577:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144e2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.898729:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.898747:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d0 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.898758:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.898808:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d0 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.898824:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d0 expref: 50 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098226.898841:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077755776:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098226.898974:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098226.903564:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077755776:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098226.903620:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098226.904535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098226.906494:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059916160 00000100:00100000:2.0:1787098226.906515:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059916160 00010000:00010000:2.0:1787098226.906589:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d0 expref: 51 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098226.906715:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1787098226.906728:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+51:2373:x1873908059916160:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098226.906749:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098226.906758:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d0 expref: 51 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.906793:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d0 expref: 51 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.906823:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144e18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d0 expref: 51 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.906847:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:2.0:1787098226.906853:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.906865:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.906873:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.906913:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098226.906992:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098226.907012:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+50:2373:x1873908059916160:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 287us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098226.907021:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00010000:00010000:3.0:1787098226.907071:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098226.907096:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787098226.907334:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144e2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d7 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.907352:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d7 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098226.907359:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098226.907362:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787098226.907364:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623400, rc 0) 00000100:00100000:3.0:1787098226.908669:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+50:10577:x1873908059916032:12345-192.168.204.51@tcp:101:bash.0 Request processed in 10238us (10697us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787098226.908682:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1787098226.912175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.914418:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059916416 00000100:00100000:0.0:1787098226.914436:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059916416 00000100:00100000:0.0:1787098226.914529:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:0.0:1787098226.914541:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+50:10577:x1873908059916416:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:0.0:1787098226.914927:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.914950:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.915077:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787098226.915143:0:6853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787098226.915169:0:6853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdea2340 reply state 00000000ec09cf5c transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098226.915234:0:6853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787098226.915578:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10577:x1873908059916416:12345-192.168.204.51@tcp:36:bash.0 Request processed in 1036us (3414us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787098226.915588:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 105 00000020:00080000:0.0:1787098226.915595:0:6853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787098226.917890:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.917912:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.917921:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.917928:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098226.917933:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.917942:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.917979:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098226.917983:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098226.917989:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.917996:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098226.923002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.923066:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059916544 00000100:00100000:0.0:1787098226.923079:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059916544 00000100:00100000:0.0:1787098226.923162:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:0.0:1787098226.923270:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10577:x1873908059916544:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098226.923610:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098226.923638:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875de expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.923767:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.923787:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d7 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.923797:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.924082:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d7 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.924100:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d7 expref: 53 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098226.924117:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227487800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077755904:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098226.924591:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206417840 going to sleep for 11 seconds 00000100:00100000:0.0:1787098226.927767:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227487800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077755904:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098226.927808:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098226.929203:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.929753:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059916672 00000100:00100000:0.0:1787098226.929767:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059916672 00010000:00010000:0.0:1787098226.930654:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d7 expref: 54 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098226.930774:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1787098226.930788:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+54:2373:x1873908059916672:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098226.930817:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098226.930826:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d7 expref: 54 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.930841:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d7 expref: 54 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.930870:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0144e34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875d7 expref: 54 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.930891:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098226.930896:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.930907:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.930916:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098226.931086:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098226.931182:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+53:2373:x1873908059916672:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 387us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098226.931192:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00010000:00010000:2.0:1787098226.931326:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.931336:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098226.931472:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787098226.931637:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098226.931667:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.931719:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875de expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.931739:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875de expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098226.931747:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:2.0:1787098226.931750:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098226.931753:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695000, rc 0) 00000100:00100000:2.0:1787098226.931794:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10577:x1873908059916544:12345-192.168.204.51@tcp:101:bash.0 Request processed in 8623us (8806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098226.931801:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:3.0:1787098226.938515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098226.938973:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059916928 00000100:00100000:0.0:1787098226.938993:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059916928 00000100:00100000:0.0:1787098226.939165:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:0.0:1787098226.939179:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+52:10577:x1873908059916928:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:0.0:1787098226.939756:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10577:x1873908059916928:12345-192.168.204.51@tcp:35:bash.0 Request processed in 577us (1254us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787098226.939767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:1.0:1787098227.060442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.060541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059917056 00000100:00100000:2.0:1787098227.060554:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059917056 00000100:00100000:2.0:1787098227.060648:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:2.0:1787098227.060662:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+53:10583:x1873908059917056:12345-192.168.204.51@tcp:101:lfs.0 00000100:00080000:1.0:1787098227.060748:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787098227.060790:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098227.060820:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875e5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.060908:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.060991:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.061008:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098227.061110:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787098227.061115:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098227.061144:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.061176:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875e5 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.061199:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875e5 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.061209:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098227.061213:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098227.061216:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622600, rc 0) 00000100:00100000:2.0:1787098227.061513:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10583:x1873908059917056:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 853us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098227.061522:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:1.0:1787098227.066426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098227.067193:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059917184 00000100:00100000:3.0:1787098227.067209:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059917184 00000100:00100000:3.0:1787098227.067417:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:3.0:1787098227.067432:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10583:x1873908059917184:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098227.067474:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098227.067513:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875ec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.067832:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.067853:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.067868:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.067890:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.067898:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.067906:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068065:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068076:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068109:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098227.068159:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787098227.068166:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098227.068189:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068205:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068214:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068222:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068230:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068237:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.068243:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068253:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068269:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:3.0:1787098227.068325:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098227.068332:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068350:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144e6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068371:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068378:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068385:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068391:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.068395:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068402:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068411:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7207e92000) 00010000:00010000:3.0:1787098227.068414:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098227.068417:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068424:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144e73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068485:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ec expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068506:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ec expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.068524:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098227.068527:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098227.068530:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6000, rc 0) 00000100:00100000:3.0:1787098227.069046:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+55:10583:x1873908059917184:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1615us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098227.069057:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:3.0:1787098227.074180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098227.075809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.075922:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059917312 00000100:00100000:0.0:1787098227.075937:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059917312 00000100:00100000:0.0:1787098227.076038:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098227.076050:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+55:2375:x1873908059917312:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098227.076072:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098227.076116:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0144e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875ec expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.076144:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098227.076150:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098227.076216:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+54:2375:x1873908059917312:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 169us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.076224:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1787098227.078670:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059917568 00000100:00100000:3.0:1787098227.078688:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059917568 00000100:00100000:3.0:1787098227.079023:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 109 00000100:00100000:3.0:1787098227.079035:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10583:x1873908059917568:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098227.079065:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098227.079095:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144e81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875f3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.079477:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.079496:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875de expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.079506:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.079550:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875de expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.079592:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875de expref: 55 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098227.079609:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d71048ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077756032:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098227.079934:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7207ba0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098227.084995:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d71048ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077756032:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098227.085113:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098227.086140:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.086443:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059917696 00000100:00100000:2.0:1787098227.086457:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059917696 00010000:00010000:2.0:1787098227.086585:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875de expref: 56 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.086744:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:2.0:1787098227.086759:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d721fa98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+56:2374:x1873908059917696:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098227.086783:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098227.086793:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875de expref: 56 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.086840:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875de expref: 56 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.086874:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144e50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875de expref: 56 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.086903:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:2.0:1787098227.086910:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.086922:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.086932:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.087022:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098227.087105:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d721fa98450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+55:2374:x1873908059917696:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 349us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098227.087115:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00010000:00010000:3.0:1787098227.087142:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.087151:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098227.087177:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787098227.087458:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144e81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875f3 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.087490:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875f3 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.087500:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098227.087503:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787098227.087505:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7600, rc 0) 00000100:00100000:3.0:1787098227.087559:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+55:10583:x1873908059917568:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 8527us (11761us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787098227.087586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 109 00010000:00010000:3.0:1787098227.087994:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098227.092168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.092457:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059917952 00000100:00100000:0.0:1787098227.092698:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059917952 00000100:00100000:0.0:1787098227.092798:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1787098227.092812:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+55:10583:x1873908059917952:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:0.0:1787098227.092836:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098227.092874:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0144de7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875c9 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.092926:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098227.092933:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098227.093031:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10583:x1873908059917952:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 221us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.093040:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1787098227.099671:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.099754:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059918080 00000100:00100000:2.0:1787098227.099769:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059918080 00000100:00100000:2.0:1787098227.099974:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:2.0:1787098227.099988:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10583:x1873908059918080:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:2.0:1787098227.100143:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.100167:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.100205:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787098227.100562:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787098227.100697:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10583:x1873908059918080:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 711us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098227.100708:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:1.0:1787098227.108362:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.112667:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059918208 00000100:00100000:0.0:1787098227.112690:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059918208 00000100:00100000:0.0:1787098227.112852:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:0.0:1787098227.112863:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+54:10583:x1873908059918208:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098227.112891:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098227.112920:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52875fa expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.112998:0:6853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.113011:0:6853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e9d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875fa expref: 55 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.113035:0:6853:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.113050:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e9d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875fa expref: 55 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.113068:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098227.113092:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098227.113097:0:6853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e9d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875fa expref: 55 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.113106:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695600, rc 0) 00000100:00100000:0.0:1787098227.113199:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+55:10583:x1873908059918208:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 337us (4854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.113206:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00000040:00080000:1.0:1787098227.599634:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098227.599650:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098227.599744:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787098227.599756:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787098227.599929:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417cc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077756160:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787098227.600106:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723b989300 going to sleep for 11 seconds 00000100:00100000:2.0:1787098227.605402:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417cc000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077756160:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787098227.606551:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098227.606976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059918336 00000100:00100000:3.0:1787098227.607000:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059918336 00000100:00100000:3.0:1787098227.607073:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:3.0:1787098227.607085:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+55:10584:x1873908059918336:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787098227.607129:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787098227.607320:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+55:10584:x1873908059918336:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 195us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098227.607329:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:1.0:1787098227.616802:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098227.616908:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059918464 00000100:00100000:3.0:1787098227.616921:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059918464 00000100:00100000:3.0:1787098227.617009:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:3.0:1787098227.617022:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+55:10584:x1873908059918464:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787098227.617125:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.617147:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.617161:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618191:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618215:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618245:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618763:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618776:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618784:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098227.618834:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787098227.618839:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098227.618856:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618870:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618878:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618885:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618891:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.618896:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618904:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618925:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:3.0:1787098227.618928:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098227.618933:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618939:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0144ea4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618967:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618974:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618979:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618984:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.618987:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618992:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.618999:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d7207e92000) 00010000:00010000:3.0:1787098227.619002:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098227.619004:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.619010:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0144eab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.619050:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.619057:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.619063:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.619068:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.619070:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.619075:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.619082:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098227.619085:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098227.619088:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.619092:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0144eb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098227.619202:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+55:10584:x1873908059918464:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 2178us (2409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098227.619214:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:1.0:1787098227.626618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098227.626858:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059918720 00000100:00100000:3.0:1787098227.626869:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059918720 00000100:00100000:3.0:1787098227.626931:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:3.0:1787098227.626952:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+55:10584:x1873908059918720:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787098227.626975:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098227.626998:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144eb9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287601 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627122:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627138:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627149:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098227.627162:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787098227.627274:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627330:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627337:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627343:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.627347:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627354:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627368:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098227.627379:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787098227.627385:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627391:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144ec0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627440:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144eb9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287601 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627451:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:3.0:1787098227.627453:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098227.627457:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144eb9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287601 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.627469:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7000, rc 0) 00000100:00100000:3.0:1787098227.627534:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10584:x1873908059918720:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 581us (925us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787098227.627542:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:1.0:1787098227.632432:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.632603:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059918848 00000100:00100000:0.0:1787098227.632624:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059918848 00000100:00100000:0.0:1787098227.632695:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:0.0:1787098227.632705:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10584:x1873908059918848:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787098227.632745:0:6853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787098227.632857:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10584:x1873908059918848:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 153us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.632865:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:1.0:1787098227.649663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.650194:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059919104 00000100:00100000:2.0:1787098227.650207:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059919104 00000100:00100000:2.0:1787098227.650360:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1787098227.650381:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10584:x1873908059919104:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098227.650402:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098227.650405:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787098227.650433:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875e5 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.650452:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:2.0:1787098227.650457:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098227.650470:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144ece lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287608 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787098227.650935:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787098227.652507:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144ed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.652526:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.652552:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.652741:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144ece lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287608 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.652761:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287608 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.652771:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7203ead000) 00010000:00010000:2.0:1787098227.652774:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098227.652778:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623a00, rc 0) 00000100:00100000:2.0:1787098227.652906:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+57:10584:x1873908059919104:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2534us (3265us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787098227.652915:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:1.0:1787098227.675723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.675893:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059919360 00000100:00100000:0.0:1787098227.675903:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059919360 00000100:00100000:0.0:1787098227.676124:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:0.0:1787098227.676135:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+57:10584:x1873908059919360:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787098227.676211:0:6853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098227.676237:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0144ed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287608 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676270:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7203ead000) 00010000:00010000:0.0:1787098227.676335:0:6853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787098227.676381:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676396:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676405:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676419:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676425:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676430:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676505:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676512:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676519:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676525:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098227.676529:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676535:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676551:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:0.0:1787098227.676554:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098227.676557:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676563:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ee3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676573:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676579:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676584:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676589:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098227.676591:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676596:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676603:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5d6416f4 (ffff8d7208701400) 00010000:00010000:0.0:1787098227.676605:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098227.676608:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.676626:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5d6416f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.676741:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10584:x1873908059919360:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 607us (1095us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787098227.676748:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:1.0:1787098227.688869:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.688980:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059919488 00000100:00100000:0.0:1787098227.688991:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059919488 00000100:00100000:0.0:1787098227.689055:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:0.0:1787098227.689065:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+56:10584:x1873908059919488:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098227.689085:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098227.689111:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144ef1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528760f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.689146:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.689160:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.689170:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.689274:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528760f expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.689316:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528760f expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.689325:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:0.0:1787098227.689334:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787098227.689337:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:0.0:1787098227.689608:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+57:10584:x1873908059919488:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 544us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.690084:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:3.0:1787098227.702083:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.702526:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059919744 00000100:00100000:0.0:1787098227.702537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059919744 00000100:00100000:0.0:1787098227.702596:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:0.0:1787098227.702606:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+57:10584:x1873908059919744:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787098227.702706:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.702724:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.702735:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787098227.702956:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787098227.702966:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325958685224ns, next at 326958682517ns, rc = 0 00000004:00010000:0.0:1787098227.703067:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eec5b16e reply state 000000000869a6df transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.703077:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787098227.703175:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+59:10584:x1873908059919744:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 569us (1101us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787098227.703182:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00010000:00010000:3.0:1787098227.706062:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.706081:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.706089:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.706096:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.706115:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.706123:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.706141:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:3.0:1787098227.706144:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787098227.706149:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.706155:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0144eff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098227.707753:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.707876:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059919872 00000100:00100000:2.0:1787098227.707887:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059919872 00000100:00100000:0.0:1787098227.707985:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:0.0:1787098227.707999:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+58:10584:x1873908059919872:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098227.708039:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098227.708065:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287616 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.708126:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287616 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.708142:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287616 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.708169:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:0.0:1787098227.708172:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098227.708175:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695000, rc 0) 00000100:00100000:0.0:1787098227.708387:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+59:10584:x1873908059919872:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 390us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.708394:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:1.0:1787098227.711573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.711831:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059920000 00000100:00100000:0.0:1787098227.711844:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059920000 00000100:00080000:1.0:1787098227.711963:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098227.712535:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1787098227.712550:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2374:x1873908059920000:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787098227.712890:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2374:x1873908059920000:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 335us (1321us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787098227.712900:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:1.0:1787098227.716857:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098227.716954:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059920256 00000100:00100000:3.0:1787098227.716967:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059920256 00000100:00100000:3.0:1787098227.717084:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:3.0:1787098227.717095:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+59:10584:x1873908059920256:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787098227.717415:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+60:10584:x1873908059920256:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 321us (567us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787098227.717424:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:3.0:1787098227.722338:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.725572:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059920512 00000100:00100000:0.0:1787098227.725589:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059920512 00000100:00100000:0.0:1787098227.725669:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1787098227.725679:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+60:10584:x1873908059920512:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787098227.725835:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+60:10584:x1873908059920512:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 156us (3508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.725844:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1787098227.729979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.730142:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059920640 00000100:00100000:2.0:1787098227.730152:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059920640 00000100:00100000:2.0:1787098227.730319:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:2.0:1787098227.730331:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+60:10584:x1873908059920640:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098227.730352:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098227.730374:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144f0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528761d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.730469:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144f14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.730496:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.730507:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098227.730547:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098227.730565:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144f14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.730593:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0144f0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528761d expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.730611:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144f14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528761d expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.730620:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:2.0:1787098227.730623:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787098227.730626:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622600, rc 0) 00000100:00100000:2.0:1787098227.730702:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+61:10584:x1873908059920640:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 374us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098227.730710:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1787098227.734887:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.735231:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059920768 00000100:00100000:2.0:1787098227.735242:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059920768 00000100:00100000:2.0:1787098227.735342:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:2.0:1787098227.735352:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2373:x1873908059920768:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098227.735486:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098227.735522:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287624 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098227.735548:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a84f473, blocks: 0x1 00010000:00010000:2.0:1787098227.735571:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1787098227.735576:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098227.735586:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287624 expref: 10 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.735603:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287624 expref: 10 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.735729:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623a00, rc 0) 00000100:00100000:2.0:1787098227.735893:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+10:2373:x1873908059920768:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 541us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098227.735901:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:3.0:1787098227.739930:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.740046:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059921024 00000100:00100000:0.0:1787098227.740056:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059921024 00000100:00100000:0.0:1787098227.740115:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:0.0:1787098227.740125:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+61:10584:x1873908059921024:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787098227.740234:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+61:10584:x1873908059921024:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.740242:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:1.0:1787098227.745105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.745203:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059921152 00000100:00100000:2.0:1787098227.745213:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059921152 00000100:00100000:2.0:1787098227.745320:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1787098227.745331:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+10:10584:x1873908059921152:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098227.745349:0:6860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098227.745377:0:6860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528762b expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.745412:0:6860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287624 expref: 11 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.745440:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787098227.745445:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098227.745451:0:6860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 11 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.745490:0:6860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287624 expref: 11 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.745505:0:6860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287624 expref: 11 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.745522:0:6860:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6860:1873908077756288:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098227.745623:0:6860:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787098227.751762:0:6860:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6860:1873908077756288:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098227.751814:0:6860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 11 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.751838:0:6860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623e00, rc 0) 00000100:00100000:2.0:1787098227.751908:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+11:10584:x1873908059921152:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 6579us (6813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098227.751917:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1787098227.752824:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.752915:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059921280 00000100:00100000:0.0:1787098227.752922:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059921280 00010000:00010000:0.0:1787098227.752966:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287624 expref: 11 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.753005:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:0.0:1787098227.753015:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+11:2374:x1873908059921280:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098227.753030:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098227.753053:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287624 expref: 11 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.753078:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287624 expref: 11 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.753107:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4eaae12/0xb1d871f9b0144f1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287624 expref: 11 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.753144:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098227.753148:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098227.753157:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 10 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.753168:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 10 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.753201:0:11681:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 10 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.753215:0:11681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227484380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11681:1873908077756416:192.168.204.51@tcp:105: 00000100:00100000:0.0:1787098227.753332:0:11681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206417480 going to sleep for 11 seconds 00000100:00100000:0.0:1787098227.757127:0:11681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227484380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11681:1873908077756416:192.168.204.51@tcp:105: 00010000:00010000:0.0:1787098227.757159:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098227.757274:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+10:2374:x1873908059921280:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 4259us (4452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.757311:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:1.0:1787098227.760191:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.763024:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059921408 00000100:00100000:2.0:1787098227.763040:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059921408 00002000:00100000:2.0:1787098227.763186:0:6707:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d723ba01880 x1873908059921408/t0(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:403/0 lens 504/0 e 0 to 0 dl 1787098238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787098227.763227:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723ba01880 with x1873908059921408 ext(0->12) 00002000:00010000:2.0:1787098227.763234:0:6707:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d723ba01880 00000100:00100000:2.0:1787098227.763300:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1787098227.763311:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+10:2374:x1873908059921408:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787098227.764460:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+12:2374:x1873908059921408:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 1145us (4273us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787098227.764617:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00002000:00100000:2.0:1787098227.764630:0:6707:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d723ba01880 x1873908059921408/t4294967308(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:403/0 lens 504/448 e 0 to 0 dl 1787098238 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787098227.764641:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723ba01880 with x1873908059921408 ext(0->12) 00002000:00010000:2.0:1787098227.764645:0:6707:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d723ba01880 00000100:00100000:1.0:1787098227.767626:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.767721:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059921536 00000100:00100000:0.0:1787098227.767731:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059921536 00000100:00100000:0.0:1787098227.767792:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:0.0:1787098227.767803:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+61:10584:x1873908059921536:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787098227.804772:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+61:10584:x1873908059921536:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 36961us (37146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098227.804785:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000001:00080000:1.0:1787098227.804823:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1787098227.804831:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787098227.804891:0:5866:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d7202c5b600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787098227.804896:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d7204999d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d7202c5b240 00000020:00080000:1.0:1787098227.804899:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d7204999900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d724178b800 00000020:00080000:1.0:1787098227.804909:0:5866:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1787098227.804923:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:1.0:1787098227.804936:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787098227.804952:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787098227.804964:0:5866:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d723b455840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787098227.804967:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d723ba74600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d7204f45cc0 00000020:00080000:1.0:1787098227.804970:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d723ba74300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7241ad9400 00000100:00100000:0.0:1787098227.806909:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077756544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787098227.807008:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098227.807072:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098227.807079:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077756672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787098227.807114:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098227.807247:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077756800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787098227.807304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098227.807518:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077756544 00000100:00100000:2.0:1787098227.807526:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077756544 00000100:00100000:2.0:1787098227.807586:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077756672 00000100:00100000:2.0:1787098227.807590:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077756672 00000100:00100000:2.0:1787098227.807607:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077756800 00000100:00100000:2.0:1787098227.807610:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077756800 00000100:00100000:2.0:1787098227.807626:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787098227.807635:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1873908077756544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787098227.807661:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787098227.807685:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.807708:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528758a expref: 11 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.807730:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787098227.807735:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787098227.807740:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.807769:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528758a expref: 11 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.807783:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528758a expref: 11 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.807795:0:6702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1873908077756928:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098227.807853:0:6702:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098227.807868:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787098227.807875:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1873908077756672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787098227.808005:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787098227.808009:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787098227 00002000:00010000:2.0:1787098227.808011:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787098227.808013:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787098227 -> 1787098227 00002000:00010000:2.0:1787098227.808016:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787098227.808059:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3309:x1873908077756672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (943us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787098227.808065:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787098227.808084:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787098227.808112:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1873908077756800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787098227.808125:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1787098227.808143:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a84f472, atime: 0x6a84f472, ctime: 0x6a84f472, blocks: 0x1 00010000:00010000:2.0:1787098227.808148:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.808156:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1787098227.808159:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098227.808164:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.808177:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.808187:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.808194:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.808210:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787098227.808916:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1873908077756800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 804us (1609us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787098227.808925:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1787098227.808959:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098227.808966:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.808988:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623400 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098227.808992:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.809003:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.809021:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.809029:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0144f30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.809048:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098227.809050:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098227.809052:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787098227.809087:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7227487b80/2, rc 0, transno 4294967304 00000100:00080000:0.0:1787098227.809204:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098227.809264:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077756800:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1787098227.809327:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d723ba01180/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787098227.809333:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077756672:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787098227.809999:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.810677:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059921664 00000100:00100000:2.0:1787098227.810687:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059921664 00000100:00100000:2.0:1787098227.810738:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1787098227.810748:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+12:2376:x1873908059921664:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000020:00080000:1.0:1787098227.813022:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787098227.813330:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787098227.813797:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098227.813877:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059921792 00000100:00100000:3.0:1787098227.813887:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059921792 00010000:00010000:3.0:1787098227.813934:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528758a expref: 13 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098227.813994:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:3.0:1787098227.814003:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2373:x1873908059921792:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098227.814017:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098227.814023:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528758a expref: 13 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.814036:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528758a expref: 13 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.814061:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787098227.814066:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787098227.814072:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.814083:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.814115:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098227.814167:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2373:x1873908059921792:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 164us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098227.814175:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00010000:00010000:2.0:1787098227.816146:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144ceb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528758a expref: 12 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.816172:0:6702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1873908077756928:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098227.816200:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.816213:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.816221:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.816232:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.816239:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.816269:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787098227.816434:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098227.816443:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.816467:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622e00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098227.816472:0:6716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.816492:0:6716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.816513:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.816521:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fb680d5/0xb1d871f9b0144f29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.816542:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098227.816545:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098227.816547:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098227.817350:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3309:x1873908077756544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9712us (10338us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787098227.817361:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1787098227.817433:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d723ba00380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787098227.817440:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077756544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787098227.866383:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+11:2376:x1873908059921664:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 55616us (56368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098227.866399:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000001:00080000:1.0:1787098227.866608:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1787098227.866621:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1787098227.866627:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787098227.866632:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1787098227.869105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.869325:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059922048 00000100:00100000:0.0:1787098227.869335:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059922048 00000100:00100000:0.0:1787098227.869389:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:0.0:1787098227.869399:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+15:10584:x1873908059922048:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787098227.869452:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098227.869494:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0144f14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528761d expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.869517:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:0.0:1787098227.869523:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787098227.869555:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.869569:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.869579:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787098227.869827:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034ad3d9a reply state 00000000e4e419ad transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.869850:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787098227.869964:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+16:10584:x1873908059922048:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 566us (881us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787098227.869972:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:0.0:1787098227.873658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098227.873815:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059922176 00000100:00100000:1.0:1787098227.873825:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059922176 00000100:00100000:1.0:1787098227.873878:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1787098227.873887:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059922176:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787098227.874105:0:6860:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787098227.874122:0:6860:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787098227 -> 1787098226 00002000:00010000:1.0:1787098227.874124:0:6860:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787098226 00002000:00010000:1.0:1787098227.874127:0:6860:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787098227 -> 1787098226 00002000:00010000:1.0:1787098227.874129:0:6860:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787098227.874185:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059922176:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 298us (538us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787098227.874194:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00010000:00010000:2.0:1787098227.874352:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.874373:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.874380:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.874387:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098227.874392:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.874399:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.874415:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:2.0:1787098227.874418:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098227.874423:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.874429:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.881271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.881401:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059922432 00000100:00100000:0.0:1787098227.881412:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059922432 00000100:00100000:0.0:1787098227.881477:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:0.0:1787098227.881597:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+15:10584:x1873908059922432:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787098227.881673:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.881691:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528760f expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.881700:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.881738:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528760f expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.881752:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528760f expref: 15 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.881766:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077757056:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098227.881866:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206417180 going to sleep for 11 seconds 00000100:00100000:2.0:1787098227.884413:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077757056:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098227.884447:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.886347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098227.886610:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059922560 00000100:00100000:3.0:1787098227.886620:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059922560 00010000:00010000:3.0:1787098227.886927:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528760f expref: 16 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098227.887034:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:3.0:1787098227.887045:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+16:2373:x1873908059922560:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098227.887061:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098227.887079:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528760f expref: 16 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.887092:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528760f expref: 16 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.887116:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0144ef8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528760f expref: 16 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.887135:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:3.0:1787098227.887140:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.887150:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.887176:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.887208:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098227.887302:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098227.887312:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+15:2373:x1873908059922560:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 235us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098227.887330:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00010000:00010000:2.0:1787098227.887330:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.887579:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.887588:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.887595:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.887601:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098227.887606:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.887614:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.887625:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:2.0:1787098227.887628:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787098227.887632:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.887638:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0144f3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.887697:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+14:10584:x1873908059922432:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 6105us (6447us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787098227.887707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:2.0:1787098227.899016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.899200:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059922688 00000100:00100000:0.0:1787098227.899212:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059922688 00000100:00100000:0.0:1787098227.899365:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1787098227.899377:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059922688:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787098227.899425:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.899447:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 7 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.899456:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098227.899461:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098227.899466:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.899517:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 7 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.899532:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 7 pid: 6860 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.899547:0:6701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1873908077757184:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098227.899634:0:6701:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206417b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787098227.903409:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.903606:0:6701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1873908077757184:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098227.903631:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059922816 00010000:00010000:2.0:1787098227.903638:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098227.903648:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059922816 00010000:00010000:1.0:1787098227.903688:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 8 pid: 6860 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098227.903726:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:1.0:1787098227.903737:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059922816:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098227.903752:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098227.903776:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 8 pid: 6860 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.903789:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 8 pid: 6860 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.903813:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b9a8acd/0xb1d871f9b0144f22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528762b expref: 8 pid: 6860 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.903834:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787098227.903838:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787098227.903860:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.903871:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.903904:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098227.903979:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059922816:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 244us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098227.903994:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00010000:00010000:2.0:1787098227.905053:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.905070:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.905184:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.905195:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.905204:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.905212:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098227.905217:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.905226:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.905272:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.905314:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b0144f45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.905462:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059922688:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 6082us (6452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098227.905590:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1787098227.908579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.908738:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059923072 00000100:00100000:2.0:1787098227.908749:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059923072 00000100:00100000:2.0:1787098227.908813:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:2.0:1787098227.908823:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+14:10584:x1873908059923072:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787098227.908915:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.908933:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.908944:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.910662:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.910685:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287616 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.910711:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.910752:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287616 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.910767:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287616 expref: 15 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.910782:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077757312:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098227.910864:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098227.914223:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098227.914636:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077757312:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098227.914672:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.914757:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059923200 00000100:00100000:0.0:1787098227.914764:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059923200 00010000:00010000:0.0:1787098227.914815:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287616 expref: 16 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.914845:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:0.0:1787098227.914855:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+16:2374:x1873908059923200:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098227.914870:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098227.914877:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287616 expref: 16 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.914888:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287616 expref: 16 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.914911:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0144f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287616 expref: 16 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.914926:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:0.0:1787098227.914931:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.914941:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.914948:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.914978:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098227.915037:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+15:2374:x1873908059923200:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 182us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.915045:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00010000:00010000:2.0:1787098227.915229:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098227.915237:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098227.916672:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787098227.916853:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787098227.916896:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787098227.916971:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1873908077757440:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787098227.917027:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098227.917049:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787098227.917595:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077757440 00000100:00100000:0.0:1787098227.917604:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077757440 00000100:00100000:0.0:1787098227.917652:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787098227.917662:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1873908077757440:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787098227.917762:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1873908077757440:12345-0@lo:1000:mdt00_000.0 Request processed in 101us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098227.917769:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787098227.917832:0:5843:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1787098227.917838:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7203e0ad80, transno 4294967303 00000004:00080000:3.0:1787098227.917857:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1787098227.917878:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d723ba01180, transno 4294967309 00000100:00100000:3.0:1787098227.917887:0:5843:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d723ba00380 x1873908077756544/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787098243 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098227.917900:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e1ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1873908077757440:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787098227.918467:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1787098227.918541:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1873908077757568:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787098227.918585:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098227.918616:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7208bc6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787098227.919458:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077757568 00000100:00100000:2.0:1787098227.919467:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077757568 00000100:00100000:2.0:1787098227.919508:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787098227.919518:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1873908077757568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787098227.919725:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1873908077757568:12345-0@lo:1000:mdt00_000.0 Request processed in 208us (1139us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787098227.919733:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787098227.920041:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1873908077757568:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787098227.920082:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920093:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920102:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920120:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.920125:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920132:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920147:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701400) 00010000:00010000:3.0:1787098227.920150:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787098227.920155:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920161:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622c00/0xb1d871f9b0144f53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920188:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920194:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920199:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920203:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.920206:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920211:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920228:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098227.920232:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787098227.920240:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875fa expref: 18 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920252:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875fa expref: 18 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920271:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875fa expref: 18 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.920326:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875fa expref: 18 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098227.920341:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d71048af480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077757696:192.168.204.51@tcp:105: 00000100:00100000:3.0:1787098227.920546:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7208bc6300 going to sleep for 11 seconds 00000100:00100000:3.0:1787098227.926597:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d71048af480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077757696:192.168.204.51@tcp:105: 00010000:00010000:3.0:1787098227.926628:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926651:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144e96 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926684:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926698:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926724:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926734:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926740:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926747:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926752:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.926756:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926763:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926774:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098227.926777:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098227.926781:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926786:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144f5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926799:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926805:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926819:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926824:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098227.926827:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926832:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926840:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098227.926842:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787098227.926844:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.926850:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098227.927080:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:10584:x1873908059923072:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 18256us (18511us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787098227.927092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000020:00080000:3.0:1787098227.927098:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787098227.927347:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787098227.927352:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787098227.927910:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787098227.927919:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787098227.931913:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098227.934176:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059923328 00000100:00100000:3.0:1787098227.934198:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059923328 00000100:00100000:3.0:1787098227.934308:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1787098227.934318:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:10583:x1873908059923328:12345-192.168.204.51@tcp:49:lfs.0 00000100:00100000:3.0:1787098227.934458:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:10583:x1873908059923328:12345-192.168.204.51@tcp:49:lfs.0 Request processed in 142us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098227.934482:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1787098227.942813:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098227.942969:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059923584 00000100:00100000:3.0:1787098227.942980:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059923584 00000100:00100000:3.0:1787098227.943041:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:3.0:1787098227.943052:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:10584:x1873908059923584:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787098227.946325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098227.946434:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059923840 00000100:00100000:1.0:1787098227.946444:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059923840 00000100:00100000:1.0:1787098227.946505:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:1.0:1787098227.946515:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7206def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+20:10583:x1873908059923840:12345-192.168.204.51@tcp:58:lfs.0 00000040:00080000:1.0:1787098227.947086:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787098227.947181:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7206def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+20:10583:x1873908059923840:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 664us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098227.947190:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000004:00080000:0.0:1787098227.947987:0:5846:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787098227.948083:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787098227.948162:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.948180:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.948190:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.948198:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.948204:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.948211:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098227.948235:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787098227.948306:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098227.948314:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.948323:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098227.948328:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.948337:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.948352:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d7208701700) 00000100:00100000:0.0:1787098227.948354:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+20:10584:x1873908059923584:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 5301us (5550us total) trans 4294967408 rc 0/0 00010000:00010000:3.0:1787098227.948356:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787098227.948362:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098227.948377:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0144f61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098227.948383:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000020:00080000:0.0:1787098227.948391:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787098227.948402:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098227.948405:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098227.948407:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098227.974765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098227.974840:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059923968 00000100:00100000:1.0:1787098227.974852:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059923968 00000100:00100000:1.0:1787098227.974964:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:1.0:1787098227.974975:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+20:10586:x1873908059923968:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1787098227.974998:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098227.975019:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413c00/0xb1d871f9b0144f68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287632 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975083:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975111:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975122:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975139:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975146:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975153:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975932:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975947:0:6853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875f3 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975955:0:6853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.975992:0:6853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875f3 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.976006:0:6853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875f3 expref: 21 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098227.976032:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077757824:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098227.976132:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723b989900 going to sleep for 11 seconds 00000100:00100000:1.0:1787098227.979113:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077757824:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098227.979146:0:6853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098227.983232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098227.986657:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059924224 00000100:00100000:0.0:1787098227.986676:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059924224 00000100:00100000:0.0:1787098227.986825:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:0.0:1787098227.986838:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+22:5610:x1873908059924224:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787098227.987115:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+23:5610:x1873908059924224:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 267us (4825us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787098227.987125:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1787098227.989426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098227.989555:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059924352 00000100:00100000:1.0:1787098227.989565:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059924352 00010000:00010000:1.0:1787098227.989603:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875f3 expref: 23 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098227.989645:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1787098227.989654:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7208e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+23:2373:x1873908059924352:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098227.989669:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098227.989675:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875f3 expref: 23 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.989699:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875f3 expref: 23 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.989720:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0144e88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875f3 expref: 23 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.989739:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:1.0:1787098227.989744:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.989768:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.989775:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.989801:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098227.989850:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7208e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+22:2373:x1873908059924352:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 197us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098227.989858:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00010000:00010000:1.0:1787098227.989909:0:6853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.989918:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098227.989959:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787098227.989963:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787098227.989982:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.989994:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990003:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990009:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990015:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990028:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098227.990032:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990040:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990049:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:1.0:1787098227.990052:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098227.990055:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990061:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990071:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990076:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990082:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990087:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098227.990090:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990095:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990112:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d7208d7f100) 00010000:00010000:1.0:1787098227.990114:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098227.990117:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990122:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990157:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413c00/0xb1d871f9b0144f68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287632 expref: 22 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990171:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287632 expref: 21 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098227.990179:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:1.0:1787098227.990181:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787098227.990184:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413a00, rc 0) 00000100:00100000:1.0:1787098227.990210:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+21:10586:x1873908059923968:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 15238us (15456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098227.990218:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00010000:00010000:3.0:1787098228.111608:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098228.367473:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077757952:0@lo:400:kworker.0 00000100:00100000:3.0:1787098228.367474:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077758080:0@lo:400:kworker.0 00000100:00100000:0.0:1787098228.368424:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098228.368457:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077758336:0@lo:400:kworker.0 00000100:00100000:1.0:1787098228.368503:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098228.368505:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077758208:0@lo:400:kworker.0 00000100:00100000:0.0:1787098228.368542:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098228.368550:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077757952 00000100:00100000:1.0:1787098228.368559:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077757952 00000100:00100000:0.0:1787098228.368582:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077758336 00000100:00100000:0.0:1787098228.368587:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077758336 00000100:00100000:1.0:1787098228.368614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787098228.368624:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077757952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098228.368630:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077758208 00000100:00100000:0.0:1787098228.368635:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077758208 00000100:00100000:0.0:1787098228.368663:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787098228.368672:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077758336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098228.368680:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077757952:12345-0@lo:400:kworker.0 Request processed in 56us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098228.368696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787098228.368721:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077758336:12345-0@lo:400:kworker.0 Request processed in 49us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098228.368729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787098228.368737:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787098228.368747:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077758208:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787098228.368753:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098228.368782:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077757952:0@lo:400:kworker.0 00000100:00100000:1.0:1787098228.368805:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077758208:12345-0@lo:400:kworker.0 Request processed in 59us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098228.368812:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787098228.368818:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077758208:0@lo:400:kworker.0 00000100:00100000:1.0:1787098228.368850:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077758336:0@lo:400:kworker.0 00000100:00100000:3.0:1787098228.370437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098228.370493:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077758080 00000100:00100000:3.0:1787098228.370499:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077758080 00000100:00100000:3.0:1787098228.370534:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787098228.370542:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077758080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098228.370591:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077758080:12345-0@lo:400:kworker.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098228.370598:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787098228.370634:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077758080:0@lo:400:kworker.0 00000040:00080000:2.0:1787098228.741136:0:12119:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787098228.741146:0:12119:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787098228.741191:0:12119:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787098228.741199:0:12119:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787098228.881031:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787098228.881054:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077758464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098228.881123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098228.881226:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077758464 00000100:00100000:2.0:1787098228.881245:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077758464 00000100:00100000:2.0:1787098228.881334:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787098228.881346:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1873908077758464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787098228.881379:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098228.881425:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1873908077758464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098228.881433:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787098228.881492:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787098228.881529:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077758464:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787098228.943482:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787098228.943491:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787098228.943555:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787098228.943563:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787098228.943689:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b724380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077758592:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787098228.943851:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72076b8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787098228.950618:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b724380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077758592:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787098228.956577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098228.956677:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059924480 00000100:00100000:2.0:1787098228.956689:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059924480 00000100:00100000:2.0:1787098228.956750:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:2.0:1787098228.956761:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+21:10598:x1873908059924480:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787098228.956799:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787098228.956925:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+21:10598:x1873908059924480:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 166us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098228.956933:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:3.0:1787098228.961163:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098228.961257:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059924736 00000100:00100000:1.0:1787098228.961268:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059924736 00000100:00100000:1.0:1787098228.961374:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:1.0:1787098228.961384:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+21:10598:x1873908059924736:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787098228.961406:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098228.961429:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287639 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098228.961534:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098228.961549:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098228.961578:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098228.961591:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787098228.961959:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0144f84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287639 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098228.961978:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287639 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098228.961988:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:1.0:1787098228.961991:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787098228.961995:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413800, rc 0) 00000100:00100000:1.0:1787098228.962108:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+23:10598:x1873908059924736:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 725us (954us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787098228.962117:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:1.0:1787098228.967518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098228.967622:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059924992 00000100:00100000:2.0:1787098228.967633:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059924992 00000100:00100000:2.0:1787098228.967704:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:2.0:1787098228.967715:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+23:10598:x1873908059924992:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787098228.967799:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098228.967817:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098228.967829:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098228.968041:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098228.968057:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098228.968064:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098228.968070:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098228.968074:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098228.968082:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098228.968096:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:2.0:1787098228.968099:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787098228.968104:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098228.968109:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0144f99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787098228.968543:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098228.968548:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098228.969028:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787098228.969039:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787098228.969260:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+24:10598:x1873908059924992:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 1540us (1745us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787098228.969273:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:0.0:1787098228.970604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098228.971626:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059925120 00000100:00100000:1.0:1787098228.971640:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059925120 00000100:00100000:1.0:1787098228.971753:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1787098228.971763:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+24:2375:x1873908059925120:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098228.971779:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098228.971805:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b0144f8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287639 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098228.971838:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:1.0:1787098228.971843:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098228.971905:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+23:2375:x1873908059925120:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 143us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098228.971912:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1787098228.973670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098228.973782:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059925376 00000100:00100000:3.0:1787098228.973791:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059925376 00000100:00100000:3.0:1787098228.973848:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1787098228.973857:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+23:10598:x1873908059925376:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787098228.974108:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+24:10598:x1873908059925376:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 251us (445us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787098228.974116:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00010000:00010000:1.0:1787098229.135563:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098230.165850:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787098230.663893:0:12170:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098230.663903:0:12170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098230.663944:0:12170:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787098230.663951:0:12170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787098230.815755:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098230.815800:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098230.815831:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098230.815857:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098230.815877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098230.815903:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059926016 00000100:00100000:1.0:1787098230.815911:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059926016 00000100:00100000:1.0:1787098230.815965:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059925632 00000100:00100000:1.0:1787098230.815967:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059925632 00000100:00100000:1.0:1787098230.815988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:1.0:1787098230.815998:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059926016:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098230.816063:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059926016:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098230.816071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:1.0:1787098230.816087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:1.0:1787098230.816093:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+24:2373:x1873908059925632:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098230.816129:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+24:2373:x1873908059925632:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098230.816136:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:1.0:1787098230.816151:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059925760 00000100:00100000:1.0:1787098230.816154:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059925760 00000100:00100000:1.0:1787098230.816176:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059925888 00000100:00100000:1.0:1787098230.816178:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059925888 00000100:00100000:1.0:1787098230.816209:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:1.0:1787098230.816216:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059925760:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098230.816242:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059925760:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098230.816249:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:1.0:1787098230.816259:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:1.0:1787098230.816264:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059925888:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098230.816312:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059925888:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 47us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098230.816319:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00080000:1.0:1787098230.816334:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098230.816337:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098230.816340:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098230.816585:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059925504 00000100:00100000:0.0:1787098230.816590:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059925504 00000100:00100000:0.0:1787098230.816627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 281 00000100:00100000:0.0:1787098230.816635:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059925504:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098230.816673:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059925504:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098230.816679:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 281 00000100:00100000:3.0:1787098230.849561:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098230.849594:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059926272 00000100:00100000:3.0:1787098230.849605:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059926272 00000100:00100000:3.0:1787098230.849669:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:3.0:1787098230.849678:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+24:10618:x1873908059926272:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098230.849699:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098230.849722:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fa0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287640 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.849840:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144fa7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.849854:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.849868:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098230.849881:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787098230.850005:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fa0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287640 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.850023:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287640 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.850032:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098230.850035:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787098230.850038:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6400, rc 0) 00000100:00100000:3.0:1787098230.850093:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+26:10618:x1873908059926272:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 415us (542us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787098230.850099:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:0.0:1787098230.859372:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098230.860505:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059926400 00000100:00100000:3.0:1787098230.860517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059926400 00000100:00100000:3.0:1787098230.860575:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:3.0:1787098230.860584:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+26:10618:x1873908059926400:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:3.0:1787098230.860656:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.860690:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.860701:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.860729:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.860736:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.860743:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.860750:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098230.860754:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.860760:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.860771:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:3.0:1787098230.860775:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098230.860779:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098230.860785:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0144fb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098230.860866:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+26:10618:x1873908059926400:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 281us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098230.860879:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:0.0:1787098230.927664:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098230.927747:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098230.928054:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077758720 00000100:00100000:3.0:1787098230.928062:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077758720 00000100:00080000:1.0:1787098230.928129:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787098230.928140:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787098230.928153:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873908077758720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787098230.928185:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098230.928248:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873908077758720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098230.928255:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787098230.928471:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098230.957657:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098230.957810:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059926528 00000100:00100000:2.0:1787098230.957819:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059926528 00000100:00100000:2.0:1787098230.957877:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1787098230.957887:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059926528:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1787098230.957916:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098230.957937:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035915df7/0xb1d871f9b0144fbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287647 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098230.957964:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a84f472, atime: 0x6a84f472, ctime: 0x6a84f472, blocks: 0xb 00010000:00010000:2.0:1787098230.957982:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1787098230.957987:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098230.957997:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035915df7/0xb1d871f9b0144fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287647 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098230.958017:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035915df7/0xb1d871f9b0144fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287647 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098230.958031:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622c00, rc 0) 00000100:00100000:2.0:1787098230.958266:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059926528:12345-192.168.204.51@tcp:101:cat.0 Request processed in 378us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098230.958274:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:0.0:1787098230.972253:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098230.972316:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059926656 00000100:00100000:0.0:1787098230.972325:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059926656 00002000:00100000:0.0:1787098230.972371:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d7203e0b480 x1873908059926656/t0(0) o3->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:406/0 lens 488/0 e 0 to 0 dl 1787098241 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787098230.972382:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7203e0b480 with x1873908059926656 ext(0->4095) 00002000:00010000:0.0:1787098230.972389:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d7203e0b480 00000100:00100000:0.0:1787098230.972416:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1787098230.972425:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059926656:12345-192.168.204.51@tcp:3:cat.0 00000100:00100000:0.0:1787098230.972625:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059926656:12345-192.168.204.51@tcp:3:cat.0 Request processed in 200us (381us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787098230.972633:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00002000:00100000:0.0:1787098230.972640:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8d7203e0b480 x1873908059926656/t0(0) o3->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:406/0 lens 488/4536 e 0 to 0 dl 1787098241 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787098230.972654:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7203e0b480 with x1873908059926656 ext(0->4095) 00002000:00010000:0.0:1787098230.972657:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d7203e0b480 00000001:00080000:1.0:1787098230.979462:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1787098230.979479:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1787098230.979489:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1787098231.183941:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098232.207402:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787098233.082177:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000001:00080000:2.0:1787098233.082215:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:2.0:1787098233.082226:0:5866:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1787098233.082250:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:2.0:1787098233.082276:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787098233.082312:0:5866:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d7208bc63c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787098233.082319:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d723ba74100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d7208bc6240 00000020:00080000:2.0:1787098233.082323:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d723ba74b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7241c56c00 00000020:00080000:1.0:1787098233.082376:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787098233.082628:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1787098233.088172:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1787098233.088498:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1787098233.233138:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098233.494515:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077759104:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.494612:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098233.494691:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787098233.494698:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077758976:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.494725:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098233.494743:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077759488:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.494771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098233.494830:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077759232:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.494856:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098233.494877:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787098233.494883:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077758848:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.494913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098233.494935:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1873908077759360:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.494958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098233.494997:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077759104 00000100:00100000:0.0:1787098233.495007:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077759104 00000100:00100000:0.0:1787098233.495068:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077758976 00000100:00100000:0.0:1787098233.495071:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077758976 00000100:00100000:0.0:1787098233.495083:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077759360 00000100:00100000:0.0:1787098233.495086:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077759360 00000100:00100000:0.0:1787098233.495103:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787098233.495113:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077759104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.495189:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077759104:12345-0@lo:400:kworker.0 Request processed in 76us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098233.495213:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787098233.495243:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787098233.495249:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077758976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.495308:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077758976:12345-0@lo:400:kworker.0 Request processed in 59us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098233.495315:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787098233.495328:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787098233.495334:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873908077759360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.495367:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873908077759360:12345-0@lo:400:kworker.0 Request processed in 34us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098233.495373:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787098233.495412:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1873908077759360:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.495441:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077758976:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.495451:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077759104:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.495485:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077759488 00000100:00100000:0.0:1787098233.495489:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077759488 00000100:00100000:0.0:1787098233.495519:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077759232 00000100:00100000:0.0:1787098233.495522:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077759232 00000100:00100000:0.0:1787098233.495544:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787098233.495549:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077759488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.495584:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077759488:12345-0@lo:400:kworker.0 Request processed in 35us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098233.495590:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787098233.495600:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787098233.495615:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077759232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.495653:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077759232:12345-0@lo:400:kworker.0 Request processed in 40us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098233.495659:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787098233.495691:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1787098233.495698:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d723ba00380, transno 4294967310 00000004:00080000:0.0:1787098233.495711:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1787098233.495732:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077759232:0@lo:400:kworker.0 00000100:00100000:0.0:1787098233.495753:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787098233.495757:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787098233.495769:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7227487b80, transno 4294967304 00000100:00100000:0.0:1787098233.495780:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077759488:0@lo:400:kworker.0 00000100:00100000:1.0:1787098233.499185:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077758848 00000100:00100000:1.0:1787098233.499204:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077758848 00000100:00100000:1.0:1787098233.499317:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787098233.499329:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077758848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098233.499454:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077758848:12345-0@lo:400:kworker.0 Request processed in 128us (4540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098233.499463:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:1.0:1787098233.499508:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098233.499515:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098233.499519:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098233.501140:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077758848:0@lo:400:kworker.0 00000100:00100000:2.0:1787098234.000502:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077759616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098234.000601:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098234.000694:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077759616 00000100:00100000:2.0:1787098234.003874:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077759616 00000100:00100000:2.0:1787098234.003994:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787098234.004008:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077759616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787098234.004065:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098234.004197:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077759616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (3595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098234.004206:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787098234.004666:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077759616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787098234.256146:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787098235.169625:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787098235.169637:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787098235.170024:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1787098235.170032:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787098235.281650:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098235.932634:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098235.932686:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098235.932719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098235.932745:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098235.932773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098235.932822:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059927296 00000100:00100000:0.0:1787098235.932835:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059927296 00000100:00100000:0.0:1787098235.932915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059926912 00000100:00100000:0.0:1787098235.932918:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059926912 00000100:00100000:0.0:1787098235.932943:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:0.0:1787098235.932954:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2374:x1873908059927296:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098235.933068:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2374:x1873908059927296:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 115us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098235.933077:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:0.0:1787098235.933115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:0.0:1787098235.933131:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2374:x1873908059926912:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098235.933159:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2374:x1873908059926912:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098235.933308:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059927040 00000100:00100000:3.0:1787098235.933313:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059927040 00000100:00100000:3.0:1787098235.933345:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059927168 00000100:00100000:3.0:1787098235.933347:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059927168 00000100:00100000:3.0:1787098235.933368:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:3.0:1787098235.933374:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059927040:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098235.933400:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059927040:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098235.933407:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:3.0:1787098235.933419:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1787098235.933424:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059927168:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098235.933453:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059927168:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098235.933459:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:1.0:1787098235.933686:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059926784 00000100:00100000:1.0:1787098235.933691:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059926784 00000100:00100000:1.0:1787098235.933731:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 283 00000100:00100000:1.0:1787098235.933738:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059926784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098235.933766:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059926784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098235.933772:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 283 00000100:00080000:1.0:1787098235.933853:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098235.933859:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098235.933862:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098235.933992:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:0.0:1787098236.050843:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077759744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098236.050915:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098236.051000:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077759744 00000100:00100000:0.0:1787098236.051008:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077759744 00000100:00100000:0.0:1787098236.051059:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787098236.051068:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077759744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098236.051112:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098236.051159:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077759744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098236.051166:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787098236.051193:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098236.051231:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077759744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787098236.303950:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098236.320020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098236.320213:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059927424 00000100:00100000:2.0:1787098236.320224:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059927424 00000100:00100000:2.0:1787098236.320324:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:2.0:1787098236.320335:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+13:10263:x1873908059927424:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787098236.320435:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+13:10263:x1873908059927424:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 103us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098236.320443:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:1.0:1787098236.324959:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098236.325678:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059927680 00000100:00100000:2.0:1787098236.325690:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059927680 00000100:00100000:2.0:1787098236.325757:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:2.0:1787098236.325767:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+13:10263:x1873908059927680:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787098236.327218:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+14:10263:x1873908059927680:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1444us (2262us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787098236.327231:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1787098236.567035:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098236.567217:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059927808 00000100:00100000:2.0:1787098236.567239:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059927808 00000100:00100000:2.0:1787098236.567353:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:2.0:1787098236.567363:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:11071:x1873908059927808:12345-192.168.204.51@tcp:101:lsof.0 00010000:00010000:2.0:1787098236.567382:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098236.567402:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144fc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528764e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098236.567468:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098236.567481:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098236.567493:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098236.567694:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787098236.567698:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098236.567802:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098236.568055:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b0144fc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528764e expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098236.568073:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528764e expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098236.568081:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:2.0:1787098236.568095:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098236.568099:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622800, rc 0) 00000100:00100000:2.0:1787098236.568363:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:11071:x1873908059927808:12345-192.168.204.51@tcp:101:lsof.0 Request processed in 1001us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098236.568371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00010000:00010000:3.0:1787098237.333038:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787098238.164272:0:5866:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1787098238.164354:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787098238.164488:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787098238.164504:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787098238.351733:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098238.609199:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077759872:0@lo:400:kworker.0 00000100:00100000:0.0:1787098238.609323:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098238.609392:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077759872 00000100:00100000:1.0:1787098238.609407:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077759872 00000100:00100000:1.0:1787098238.609508:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787098238.609521:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077759872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098238.609567:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077760000:0@lo:400:kworker.0 00000100:00100000:0.0:1787098238.609668:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077759872:0@lo:400:kworker.0 00000100:00100000:0.0:1787098238.609693:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077760384:0@lo:400:kworker.0 00000100:00100000:2.0:1787098238.609729:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098238.609755:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077760512:0@lo:400:kworker.0 00000100:00100000:1.0:1787098238.609769:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077759872:12345-0@lo:400:kworker.0 Request processed in 248us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098238.609779:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787098238.609787:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098238.609818:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787098238.609825:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077760128:0@lo:400:kworker.0 00000100:00100000:2.0:1787098238.609852:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098238.609892:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077760000 00000100:00100000:1.0:1787098238.609898:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077760000 00000100:00100000:2.0:1787098238.609906:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077760512 00000100:00100000:2.0:1787098238.609914:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077760512 00000100:00100000:1.0:1787098238.609941:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077760128 00000100:00100000:1.0:1787098238.609946:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077760128 00000100:00100000:1.0:1787098238.609980:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787098238.609987:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077760000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098238.610039:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077760000:12345-0@lo:400:kworker.0 Request processed in 53us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098238.610055:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787098238.610068:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787098238.610074:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077760128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098238.610103:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077760128:12345-0@lo:400:kworker.0 Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098238.610108:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1787098238.610147:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787098238.610152:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787098238.611837:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077760256:0@lo:400:kworker.0 00000100:00100000:3.0:1787098238.612117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098238.612326:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077760128:0@lo:400:kworker.0 00000100:00100000:3.0:1787098238.612343:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077760000:0@lo:400:kworker.0 00000100:00100000:0.0:1787098238.612769:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098238.612872:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077760384 00000100:00100000:3.0:1787098238.612879:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077760384 00000100:00080000:0.0:1787098238.613215:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098238.613329:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787098238.613340:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077760384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098238.613418:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077760384:12345-0@lo:400:kworker.0 Request processed in 80us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098238.613427:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787098238.613450:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077760256 00000100:00100000:1.0:1787098238.613463:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077760256 00000100:00100000:0.0:1787098238.613698:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077760384:0@lo:400:kworker.0 00000100:00080000:0.0:1787098238.613738:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098238.614223:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787098238.614239:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077760512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098238.614705:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077760512:12345-0@lo:400:kworker.0 Request processed in 472us (4918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098238.614713:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787098238.614755:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077760512:0@lo:400:kworker.0 00000100:00100000:2.0:1787098238.616815:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787098238.616845:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077760256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098238.617120:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077760256:12345-0@lo:400:kworker.0 Request processed in 291us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098238.617267:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077760256:0@lo:400:kworker.0 00000100:00100000:2.0:1787098238.619684:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787098239.119717:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077760640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098239.119801:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098239.119876:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077760640 00000100:00100000:0.0:1787098239.119885:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077760640 00000100:00100000:0.0:1787098239.119951:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787098239.119961:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077760640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098239.119995:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098239.120060:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077760640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098239.120068:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787098239.120234:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077760640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787098239.375544:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098240.400796:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787098240.426448:0:12376:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:10:39 (1787098239) 00000100:00100000:0.0:1787098241.055103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098241.055169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098241.055198:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098241.055230:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059928064 00000100:00100000:0.0:1787098241.055234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098241.055243:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059928064 00000100:00100000:0.0:1787098241.055274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098241.055338:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059928320 00000100:00100000:0.0:1787098241.055344:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059928320 00000100:00100000:1.0:1787098241.055345:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059928448 00000100:00100000:1.0:1787098241.055364:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059928448 00000100:00100000:0.0:1787098241.055383:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059928192 00000100:00100000:0.0:1787098241.055388:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059928192 00000100:00100000:1.0:1787098241.055403:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:1.0:1787098241.055416:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2374:x1873908059928064:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098241.055423:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:0.0:1787098241.055434:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059928320:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098241.055501:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059928320:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 69us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098241.055510:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:2.0:1787098241.055532:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:2.0:1787098241.055545:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059928192:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098241.055584:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059927936 00000100:00100000:3.0:1787098241.055589:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059927936 00000100:00100000:3.0:1787098241.055620:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 285 00000100:00100000:3.0:1787098241.055627:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059927936:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098241.055844:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2374:x1873908059928064:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 431us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098241.055852:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:1.0:1787098241.055869:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:1.0:1787098241.055876:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2373:x1873908059928448:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098241.055902:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2373:x1873908059928448:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098241.055908:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00080000:1.0:1787098241.055946:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098241.055950:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098241.055953:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098241.056582:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059928192:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 1035us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098241.058086:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:3.0:1787098241.062515:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059927936:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 6875us (7332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098241.062531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 285 00000100:00100000:3.0:1787098241.170169:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787098241.170194:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077760768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098241.170268:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098241.170366:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077760768 00000100:00100000:3.0:1787098241.170373:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077760768 00000100:00080000:0.0:1787098241.170582:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787098241.170601:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787098241.170612:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077760768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787098241.170645:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098241.170854:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077760768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098241.170862:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787098241.172463:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077760768:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787098241.423812:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098241.601088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098241.601181:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059928704 00000100:00100000:1.0:1787098241.601191:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059928704 00000100:00100000:1.0:1787098241.601271:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:1.0:1787098241.601307:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:11336:x1873908059928704:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787098241.601328:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098241.601351:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413c00/0xb1d871f9b0144fd1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287655 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.601434:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.601449:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.601479:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.601496:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.601503:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.601510:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.601919:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0144fe6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.601930:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0144fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.601937:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0144fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098241.601947:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787098241.602166:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602174:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602181:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602187:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098241.602197:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602205:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602218:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d7203eadb00) 00010000:00010000:1.0:1787098241.602221:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098241.602226:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602231:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144fd8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602243:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602249:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602254:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602259:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098241.602262:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602268:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602275:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d7208d7fe00) 00010000:00010000:1.0:1787098241.602326:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098241.602335:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602341:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144fdf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602679:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413c00/0xb1d871f9b0144fd1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287655 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602694:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0144fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287655 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098241.602701:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:1.0:1787098241.602704:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098241.602706:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413e00, rc 0) 00000100:00100000:1.0:1787098241.602777:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+15:11336:x1873908059928704:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1497us (1697us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787098241.602785:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:1.0:1787098241.610272:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098241.610345:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098241.610453:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059928832 00000100:00100000:2.0:1787098241.610466:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059928832 00000100:00100000:2.0:1787098241.610550:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1787098241.610562:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+15:2376:x1873908059928832:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098241.610579:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098241.610606:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0144fe6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287655 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098241.610627:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:2.0:1787098241.610632:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098241.610687:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+14:2376:x1873908059928832:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 127us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098241.610695:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1787098241.610773:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059928960 00000100:00100000:0.0:1787098241.610778:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059928960 00000100:00100000:0.0:1787098241.610806:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:0.0:1787098241.610814:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+14:11336:x1873908059928960:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787098241.610883:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+14:11336:x1873908059928960:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 70us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098241.610890:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 138 00000040:00080000:0.0:1787098242.319756:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787098242.319765:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787098242.320425:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787098242.320435:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787098242.447402:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787098243.296726:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:2.0:1787098243.454442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098243.454800:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059929088 00000100:00100000:1.0:1787098243.454810:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059929088 00000100:00100000:1.0:1787098243.454899:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:1.0:1787098243.454910:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:11378:x1873908059929088:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1787098243.454930:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098243.454966:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528765c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455062:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455077:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455090:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455104:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455110:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455117:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455384:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455392:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455398:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455404:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098243.455408:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455437:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455451:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:1.0:1787098243.455454:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098243.455458:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455463:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0144ffb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455476:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455483:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455490:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455495:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098243.455498:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455504:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455511:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d7208d7f200) 00010000:00010000:1.0:1787098243.455513:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098243.455516:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455532:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145002 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455566:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144ff4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528765c expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455578:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:1.0:1787098243.455580:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098243.455584:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0144ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528765c expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.455593:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412e00, rc 0) 00000100:00100000:1.0:1787098243.455797:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:11378:x1873908059929088:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 888us (1366us total) trans 0 rc 301/301 00000100:00100000:1.0:1787098243.455806:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00080000:2.0:1787098243.455888:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098243.466346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098243.466404:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059929344 00000100:00100000:0.0:1787098243.466415:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059929344 00000100:00100000:0.0:1787098243.466489:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:0.0:1787098243.466501:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+13:11378:x1873908059929344:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:0.0:1787098243.466559:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098243.466585:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b0144972 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287495 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.466617:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:0.0:1787098243.466622:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787098243.467259:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.467391:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528764e expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.467401:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.467474:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528764e expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.467491:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528764e expref: 5 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098243.467506:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077760896:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098243.467670:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff733c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098243.470738:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098243.471350:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077760896:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098243.471378:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.473812:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098243.478364:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059929472 00000100:00100000:0.0:1787098243.478379:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059929472 00010000:00010000:0.0:1787098243.478447:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528764e expref: 6 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098243.478495:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00080000:3.0:1787098243.478502:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098243.478507:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2374:x1873908059929472:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098243.478523:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098243.478531:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528764e expref: 6 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.478544:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528764e expref: 6 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.478566:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0144fca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528764e expref: 6 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.478595:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:0.0:1787098243.478600:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.478609:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.478616:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.478647:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098243.478684:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.478695:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.478725:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.478735:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.478742:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098243.480182:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787098243.480198:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.480209:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.480216:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.480222:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098243.480227:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.480233:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.480248:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7203eadf00) 00010000:00010000:3.0:1787098243.480251:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098243.480255:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.480261:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145009 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098243.480304:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9c9bbda reply state 000000004ead04f1 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098243.480313:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787098243.482994:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2374:x1873908059929472:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 4479us (12256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098243.483008:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1787098243.483376:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+14:11378:x1873908059929344:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 16874us (17036us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787098243.483400:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 140 00010000:00010000:0.0:1787098243.496080:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.496098:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.496105:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.496112:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098243.496117:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.496125:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.496155:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d7207e92e00) 00010000:00010000:0.0:1787098243.496158:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098243.496163:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.496170:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145010 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098243.578917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098243.579110:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059929600 00000100:00100000:3.0:1787098243.579120:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059929600 00000100:00100000:3.0:1787098243.579189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:3.0:1787098243.579199:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+13:11386:x1873908059929600:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:3.0:1787098243.579233:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098243.579259:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287663 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.579370:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014501e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.579384:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014501e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.579396:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014501e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098243.579469:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787098243.579473:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098243.579503:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014501e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.579528:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287663 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.579549:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014501e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287663 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.579576:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:3.0:1787098243.579579:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098243.579583:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6600, rc 0) 00000100:00100000:3.0:1787098243.579639:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+14:11386:x1873908059929600:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 442us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098243.579646:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:1.0:1787098243.683657:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098243.683784:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059929728 00000100:00100000:2.0:1787098243.683795:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059929728 00000100:00100000:2.0:1787098243.683857:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:2.0:1787098243.683868:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+14:11393:x1873908059929728:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1787098243.683889:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098243.683924:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0145025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528766a expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684003:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684016:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684028:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684042:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684048:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684054:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684175:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014503a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684184:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014503a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684191:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014503a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098243.684235:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787098243.684239:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098243.684263:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014503a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684333:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684341:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684347:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684353:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098243.684358:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684364:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684377:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:2.0:1787098243.684380:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098243.684384:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684390:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b014502c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684402:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684408:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684414:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684426:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098243.684429:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684435:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684443:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d7203ead500) 00010000:00010000:2.0:1787098243.684446:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098243.684448:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684454:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145033 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684484:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b0145025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528766a expref: 16 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684498:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014503a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528766a expref: 15 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.684505:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:2.0:1787098243.684508:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787098243.684510:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623c00, rc 0) 00000100:00100000:2.0:1787098243.684579:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+15:11393:x1873908059929728:12345-192.168.204.51@tcp:101:bash.0 Request processed in 712us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098243.684587:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:0.0:1787098243.688779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098243.688976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059929984 00000100:00100000:3.0:1787098243.688988:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059929984 00000100:00100000:3.0:1787098243.689060:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:3.0:1787098243.689071:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+15:11393:x1873908059929984:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1787098243.689092:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098243.689111:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145041 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287671 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.689369:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.689385:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.689395:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.690119:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.690142:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.690169:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787098243.691700:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787098243.692131:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692146:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692154:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692192:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692199:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692206:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692213:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098243.692217:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692224:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692235:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098243.692238:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098243.692251:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692257:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145048 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098243.692274:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000332fd341 reply state 00000000d0240480 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098243.692368:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787098243.692421:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145041 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287671 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692440:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287671 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.692447:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92800) 00010000:00010000:3.0:1787098243.692450:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098243.692452:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7600, rc 0) 00000100:00100000:3.0:1787098243.692532:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+18:11393:x1873908059929984:12345-192.168.204.51@tcp:101:bash.0 Request processed in 3463us (3763us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787098243.692541:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:1.0:1787098243.697147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098243.697227:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059930112 00000100:00100000:3.0:1787098243.697239:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059930112 00000100:00100000:3.0:1787098243.697343:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1787098243.697353:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2376:x1873908059930112:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1787098243.697371:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098243.697391:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287678 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787098243.697439:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787098243.697459:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1787098243.697465:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098243.697475:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287678 expref: 6 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.697492:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287678 expref: 6 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.697505:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6000, rc 0) 00000100:00100000:3.0:1787098243.697562:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059930112:12345-192.168.204.51@tcp:101:bash.0 Request processed in 212us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098243.697570:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00010000:00010000:2.0:1787098243.697645:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.697660:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.697667:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.697673:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098243.697678:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.697686:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.697700:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92200) 00010000:00010000:2.0:1787098243.697704:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098243.697707:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.697713:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b014504f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787098243.697794:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787098243.709470:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098243.711067:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059930240 00000100:00100000:1.0:1787098243.711082:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059930240 00000100:00100000:1.0:1787098243.711161:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:1.0:1787098243.711171:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:11393:x1873908059930240:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1787098243.711189:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098243.711209:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528767f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.711244:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287678 expref: 7 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.711254:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098243.711259:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098243.711264:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.711344:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287678 expref: 7 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.711357:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287678 expref: 7 pid: 6703 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098243.711393:0:6702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1873908077761024:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098243.712238:0:6702:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff733c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098243.714736:0:6702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1873908077761024:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098243.714785:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.714813:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412c00, rc 0) 00000100:00100000:1.0:1787098243.714882:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:11393:x1873908059930240:12345-192.168.204.51@tcp:101:bash.0 Request processed in 3712us (5422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098243.714892:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1787098243.715513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098243.715603:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059930368 00000100:00100000:1.0:1787098243.715612:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059930368 00010000:00010000:1.0:1787098243.715645:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287678 expref: 7 pid: 6703 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098243.715681:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:1.0:1787098243.715690:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059930368:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098243.715704:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098243.715728:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287678 expref: 7 pid: 6703 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.715741:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287678 expref: 7 pid: 6703 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.715783:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2850e64/0xb1d871f9b0145064 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287678 expref: 7 pid: 6703 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.715800:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098243.715804:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098243.715811:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.715822:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.715855:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098243.715868:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1873908077761152:192.168.204.51@tcp:105: 00000100:00100000:1.0:1787098243.716539:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff733c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098243.724651:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098243.724718:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059930624 00000100:00100000:0.0:1787098243.724729:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059930624 00000100:00100000:1.0:1787098243.724757:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1873908077761152:192.168.204.51@tcp:105: 00010000:00010000:1.0:1787098243.724788:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098243.724804:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1787098243.724816:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+17:11393:x1873908059930624:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1787098243.724856:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059930368:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 9166us (9344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098243.724866:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1787098243.727492:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+18:11393:x1873908059930624:12345-192.168.204.51@tcp:35:bash.0 Request processed in 2666us (2839us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787098243.727507:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:2.0:1787098243.728106:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077761664:0@lo:400:kworker.0 00000100:00100000:3.0:1787098243.728172:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077761408:0@lo:400:kworker.0 00000100:00100000:2.0:1787098243.728184:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098243.728216:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098243.728228:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787098243.728238:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077761280:0@lo:400:kworker.0 00000100:00100000:3.0:1787098243.728248:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077761920:0@lo:400:kworker.0 00000100:00100000:3.0:1787098243.728300:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098243.728318:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787098243.728324:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077761536:0@lo:400:kworker.0 00000100:00100000:3.0:1787098243.728345:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098243.728359:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098243.728379:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077761408 00000100:00100000:3.0:1787098243.728385:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077761408 00000100:00100000:3.0:1787098243.728421:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077761536 00000100:00100000:3.0:1787098243.728425:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077761536 00000100:00100000:3.0:1787098243.728455:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787098243.728473:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077761408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098243.728520:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077761408:12345-0@lo:400:kworker.0 Request processed in 49us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098243.728526:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787098243.728543:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787098243.728551:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077761536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098243.728560:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1873908077761792:0@lo:400:kworker.0 00000100:00100000:3.0:1787098243.728580:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077761536:12345-0@lo:400:kworker.0 Request processed in 30us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098243.728586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787098243.728595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098243.728604:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077761792 00000100:00100000:3.0:1787098243.728608:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077761792 00000100:00100000:2.0:1787098243.728628:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077761664 00000100:00100000:3.0:1787098243.728633:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787098243.728635:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077761664 00000100:00100000:3.0:1787098243.728641:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873908077761792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098243.728671:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077761920 00000100:00100000:2.0:1787098243.728675:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077761920 00000100:00100000:3.0:1787098243.728684:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873908077761792:12345-0@lo:400:kworker.0 Request processed in 43us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098243.728693:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787098243.728705:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1787098243.728716:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787098243.728716:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72416fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077761664:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787098243.728723:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787098243.728727:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098243.728760:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72416fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077761664:12345-0@lo:400:kworker.0 Request processed in 47us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098243.728761:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077761536:0@lo:400:kworker.0 00000100:00100000:2.0:1787098243.728775:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787098243.728783:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077761408:0@lo:400:kworker.0 00000100:00100000:2.0:1787098243.728791:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787098243.728800:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077761920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098243.728828:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1873908077761792:0@lo:400:kworker.0 00000100:00100000:3.0:1787098243.728855:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077761664:0@lo:400:kworker.0 00000100:00100000:2.0:1787098243.729039:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077761920:12345-0@lo:400:kworker.0 Request processed in 240us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098243.729046:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787098243.729201:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077761920:0@lo:400:kworker.0 00000100:00100000:2.0:1787098243.729223:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077761280 00000100:00100000:2.0:1787098243.729228:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077761280 00000100:00100000:2.0:1787098243.729264:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787098243.729272:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077761280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098243.729336:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077761280:12345-0@lo:400:kworker.0 Request processed in 65us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098243.729342:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787098243.730348:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077761280:0@lo:400:kworker.0 00000100:00100000:2.0:1787098243.817688:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098243.817810:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059930880 00000100:00100000:3.0:1787098243.817819:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059930880 00000100:00100000:3.0:1787098243.817919:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:3.0:1787098243.817929:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:11403:x1873908059930880:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098243.817967:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098243.817988:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287686 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098243.818437:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787098243.818573:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145072 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287686 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.818588:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:3.0:1787098243.818591:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098243.818608:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287686 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.818624:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6e00, rc 0) 00000100:00100000:3.0:1787098243.818692:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+19:11403:x1873908059930880:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 765us (1015us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787098243.818700:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:1.0:1787098243.823779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098243.826270:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059931136 00000100:00100000:3.0:1787098243.826299:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059931136 00000100:00100000:3.0:1787098243.826377:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1787098243.826389:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+19:11403:x1873908059931136:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1787098243.826764:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+20:11403:x1873908059931136:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 377us (2995us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787098243.826773:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:2.0:1787098243.896614:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098243.896722:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059931264 00000100:00100000:3.0:1787098243.896733:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059931264 00000100:00100000:3.0:1787098243.896794:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:3.0:1787098243.896805:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+20:11409:x1873908059931264:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098243.896831:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098243.896851:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528768d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.896921:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.896935:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.896956:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098243.897018:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787098243.897022:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098243.897041:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.897075:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528768d expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.897094:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528768d expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.897116:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098243.897119:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098243.897122:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7c00, rc 0) 00000100:00100000:3.0:1787098243.897181:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+21:11409:x1873908059931264:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 377us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098243.897188:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:2.0:1787098243.903838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098243.904093:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059931520 00000100:00100000:3.0:1787098243.904104:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059931520 00000100:00100000:3.0:1787098243.904170:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:3.0:1787098243.904180:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+21:11409:x1873908059931520:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098243.904210:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098243.904234:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014508e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287694 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.904374:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.904388:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.904400:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098243.904411:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787098243.904824:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014508e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287694 expref: 24 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.904868:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287694 expref: 23 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.904875:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92800) 00010000:00010000:3.0:1787098243.904878:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098243.904881:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7000, rc 0) 00000100:00100000:3.0:1787098243.904959:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+23:11409:x1873908059931520:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 780us (1132us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787098243.904967:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:1.0:1787098243.909975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098243.910064:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059931776 00000100:00100000:3.0:1787098243.910074:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059931776 00000100:00100000:3.0:1787098243.910192:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:3.0:1787098243.910211:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+23:11409:x1873908059931776:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098243.910236:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098243.910257:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01450a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528769b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.910700:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01450aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.910716:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01450aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.910728:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01450aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098243.910742:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787098243.910889:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01450a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528769b expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.910907:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01450aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528769b expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.910915:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92800) 00010000:00010000:3.0:1787098243.910918:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787098243.910921:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030400, rc 0) 00000100:00100000:3.0:1787098243.911058:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+25:11409:x1873908059931776:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 857us (1093us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787098243.911066:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:2.0:1787098243.923605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098243.923884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098243.923978:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059932032 00000100:00100000:0.0:1787098243.923989:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059932032 00000100:00100000:0.0:1787098243.924059:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:0.0:1787098243.924069:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059932032:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:0.0:1787098243.924242:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.924263:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.924316:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787098243.924321:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098243.924325:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.924365:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.924380:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 6 pid: 6702 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098243.924395:0:6702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d71048aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1873908077762048:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098243.924538:0:6702:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722b7b1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787098243.931439:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059931904 00000100:00100000:1.0:1787098243.931471:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059931904 00000100:00100000:1.0:1787098243.931593:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1787098243.931605:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+25:2374:x1873908059931904:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098243.931625:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098243.931653:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287694 expref: 25 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.931693:0:11681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92800) 00010000:00010000:1.0:1787098243.931698:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098243.931776:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+24:2374:x1873908059931904:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 172us (8181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098243.931784:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1787098243.932005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098243.933344:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059932160 00000100:00100000:2.0:1787098243.933357:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059932160 00002000:00100000:2.0:1787098243.933412:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d723b2e2680 x1873908059932160/t0(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:419/0 lens 504/0 e 0 to 0 dl 1787098254 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787098243.933424:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b2e2680 with x1873908059932160 ext(0->12) 00010000:00010000:2.0:1787098243.933434:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 7 pid: 6702 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.933451:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 7 pid: 6702 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098243.933459:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d723b2e2680 00000100:00100000:2.0:1787098243.933493:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1787098243.933503:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059932160:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:2.0:1787098243.934796:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2373:x1873908059932160:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 1285us (2783us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787098243.934808:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00002000:00100000:2.0:1787098243.934819:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d723b2e2680 x1873908059932160/t4294967305(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:419/0 lens 504/448 e 0 to 0 dl 1787098254 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787098243.934827:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b2e2680 with x1873908059932160 ext(0->12) 00010000:00010000:2.0:1787098243.934836:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 9 pid: 6702 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.934928:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 9 pid: 6702 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098243.934958:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d723b2e2680 00000100:00100000:3.0:1787098243.935383:0:6702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d71048aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1873908077762048:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098243.935411:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098243.938725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098243.938934:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059932288 00000100:00100000:0.0:1787098243.938957:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059932288 00010000:00010000:0.0:1787098243.939430:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 9 pid: 6702 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098243.939473:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:0.0:1787098243.939484:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2376:x1873908059932288:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098243.939503:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787098243.939527:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787098243.939530:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787098243 00002000:00010000:0.0:1787098243.939533:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787098243 00002000:00010000:0.0:1787098243.939550:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787098243 00010000:00010000:0.0:1787098243.939558:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 9 pid: 6702 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.939571:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 9 pid: 6702 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.939801:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3a4e0e6/0xb1d871f9b014506b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528767f expref: 9 pid: 6702 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.939818:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098243.939824:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098243.939830:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.939839:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.940004:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098243.940069:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2376:x1873908059932288:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 579us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098243.940077:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00010000:00010000:3.0:1787098243.940932:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098243.940955:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.941172:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.941182:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.941269:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.941276:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098243.941379:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.941390:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.941407:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.941415:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01450b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098243.943454:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059932032:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 19374us (19557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098243.943470:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1787098243.955223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098243.955921:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059932544 00000100:00100000:0.0:1787098243.955933:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059932544 00000100:00100000:0.0:1787098243.956092:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:0.0:1787098243.956104:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+24:11409:x1873908059932544:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:0.0:1787098243.956175:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01450aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528769b expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787098243.956486:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787098243.956530:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787098243.963511:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787098243.963714:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.963738:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287671 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.963748:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.963790:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287671 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.963809:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287671 expref: 28 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098243.963825:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d71048aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1873908077762176:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098243.963937:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722b7b1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787098243.966777:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098243.966935:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059932672 00000100:00100000:1.0:1787098243.966964:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059932672 00010000:00010000:1.0:1787098243.967006:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287671 expref: 29 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098243.967050:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1787098243.967059:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7208e30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+29:2374:x1873908059932672:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098243.967074:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098243.967081:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287671 expref: 29 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098243.967084:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d71048aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1873908077762176:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098243.967093:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287671 expref: 29 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.967114:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287671 expref: 29 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.967774:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.967984:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92800) 00010000:00010000:1.0:1787098243.967991:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.968001:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.968008:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098243.968040:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098243.968400:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7208e30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+28:2374:x1873908059932672:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1336us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098243.968409:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00010000:00010000:0.0:1787098243.968524:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.968533:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787098243.968752:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787098243.969128:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787098243.969535:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d71048aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077762304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787098243.969747:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098243.969826:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722b7b1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787098243.969949:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077762304 00000100:00100000:1.0:1787098243.969958:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077762304 00000100:00100000:1.0:1787098243.970044:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787098243.970054:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1873908077762304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787098243.970148:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1873908077762304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098243.970155:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787098243.970244:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d71048aea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077762304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787098243.971338:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787098243.971419:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72417d8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077762432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787098243.971473:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098243.971968:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7105a86b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787098243.972121:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077762432 00000100:00100000:1.0:1787098243.972128:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077762432 00000100:00100000:1.0:1787098243.972212:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787098243.972222:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d71048aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1873908077762432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787098243.972446:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d71048aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1873908077762432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 224us (971us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787098243.972470:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787098243.972558:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72417d8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077762432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787098243.972626:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787098243.972959:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.972971:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.972978:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.972984:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098243.972988:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.972997:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.973014:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92800) 00010000:00010000:2.0:1787098243.973025:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787098243.973032:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098243.973037:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b01450bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787098243.973918:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787098243.974174:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787098243.974188:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342229907384ns, next at 343229904415ns, rc = 0 00000001:00080000:2.0:1787098243.974200:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787098243.974250:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92800) 00010000:00010000:2.0:1787098243.974254:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787098243.974264:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01450aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528769b expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098243.974652:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+31:11409:x1873908059932544:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 18490us (19380us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787098243.974664:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000020:00080000:2.0:1787098243.974671:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787098243.977445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098243.977494:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059932800 00000100:00100000:0.0:1787098243.977503:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059932800 00000100:00100000:0.0:1787098243.977565:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:0.0:1787098243.977576:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+31:11409:x1873908059932800:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098243.977601:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098243.977626:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01450c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876a2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.977846:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01450c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876a2 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.977932:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01450c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876a2 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098243.977965:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:0.0:1787098243.977969:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098243.977973:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:0.0:1787098243.978092:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+32:11409:x1873908059932800:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 517us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098243.978099:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:1.0:1787098243.982402:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098243.982506:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059933056 00000100:00100000:3.0:1787098243.982516:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059933056 00000100:00100000:3.0:1787098243.982572:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1787098243.982597:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+32:11409:x1873908059933056:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1787098243.982975:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+33:11409:x1873908059933056:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 376us (578us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787098243.982983:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1787098244.074784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098244.075021:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059933312 00000100:00100000:1.0:1787098244.075033:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059933312 00000100:00100000:1.0:1787098244.075271:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:1.0:1787098244.075302:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+33:11419:x1873908059933312:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1787098244.075330:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098244.075362:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b01450cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876a9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098244.075504:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787098244.075630:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b01450cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876a9 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.075645:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:1.0:1787098244.075648:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787098244.075654:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b01450cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876a9 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.075679:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412200, rc 0) 00000100:00100000:1.0:1787098244.075743:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+34:11419:x1873908059933312:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 462us (970us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787098244.075750:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:2.0:1787098244.080758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098244.080923:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059933440 00000100:00100000:3.0:1787098244.080934:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059933440 00000100:00100000:3.0:1787098244.081240:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:3.0:1787098244.081251:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+34:11419:x1873908059933440:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:3.0:1787098244.081500:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.081519:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.081532:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.081550:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.081557:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.081564:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.081684:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.081692:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.081822:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098244.081951:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082472:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082481:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082488:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082495:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098244.082499:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082506:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082521:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098244.082524:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098244.082528:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082535:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082552:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082569:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082575:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082581:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098244.082584:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082590:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082598:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92800) 00010000:00010000:3.0:1787098244.082600:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098244.082603:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082609:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082628:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082634:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082640:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082644:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098244.082654:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082660:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082668:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:3.0:1787098244.082670:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098244.082673:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.082678:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098244.083037:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+34:11419:x1873908059933440:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1773us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098244.083049:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:2.0:1787098244.086387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098244.086897:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059933696 00000100:00100000:0.0:1787098244.086923:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059933696 00000100:00100000:0.0:1787098244.087001:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1787098244.087012:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+34:11419:x1873908059933696:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1787098244.087625:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+35:11419:x1873908059933696:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 612us (1253us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787098244.087633:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:2.0:1787098244.138227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098244.138532:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059933952 00000100:00100000:3.0:1787098244.138544:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059933952 00000100:00100000:3.0:1787098244.138670:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:3.0:1787098244.138681:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+35:11422:x1873908059933952:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098244.138705:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098244.138729:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876b0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.138821:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.138837:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.138866:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.138882:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.138890:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.138896:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139056:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139066:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139073:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098244.139083:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787098244.139182:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139190:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139197:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139203:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098244.139220:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139228:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139242:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098244.139245:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098244.139250:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139256:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01450f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139271:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139277:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139313:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139319:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098244.139322:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139328:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139335:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92800) 00010000:00010000:3.0:1787098244.139337:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098244.139360:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139366:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01450fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139411:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b01450f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b0 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139424:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b0 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.139431:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:3.0:1787098244.139434:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098244.139436:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030400, rc 0) 00000100:00100000:3.0:1787098244.139500:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+37:11422:x1873908059933952:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 821us (1283us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1787098244.139508:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:2.0:1787098244.147744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098244.148386:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059934080 00000100:00100000:3.0:1787098244.148398:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059934080 00000100:00100000:3.0:1787098244.148459:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:3.0:1787098244.148469:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ad42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+37:11422:x1873908059934080:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:3.0:1787098244.148541:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.148559:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.148572:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.148618:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.148626:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.148633:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.148640:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098244.148644:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.148652:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.148678:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:3.0:1787098244.148682:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098244.148686:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.148693:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145113 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098244.148766:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ad42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+37:11422:x1873908059934080:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 298us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098244.148773:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:2.0:1787098244.154629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098244.156213:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059934336 00000100:00100000:3.0:1787098244.156228:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059934336 00000100:00100000:2.0:1787098244.156506:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:2.0:1787098244.156518:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+37:11422:x1873908059934336:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1787098244.156793:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+38:11422:x1873908059934336:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 276us (2174us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787098244.156809:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:3.0:1787098244.239790:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077762560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098244.239892:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098244.240110:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077762560 00000100:00100000:1.0:1787098244.240118:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077762560 00000100:00100000:1.0:1787098244.240179:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787098244.240190:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873908077762560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098244.240218:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098244.240268:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873908077762560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098244.240276:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787098244.240791:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077762560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787098244.495639:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098244.570405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098244.570604:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059934592 00000100:00100000:1.0:1787098244.570614:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059934592 00000100:00100000:1.0:1787098244.570679:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:1.0:1787098244.570689:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+38:11453:x1873908059934592:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1787098244.570715:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098244.570737:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014511a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876b7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.570849:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.570863:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.570875:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098244.570886:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787098244.571161:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014511a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b7 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.571180:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b7 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.571189:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:1.0:1787098244.571214:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787098244.571218:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412600, rc 0) 00000100:00100000:1.0:1787098244.571347:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+40:11453:x1873908059934592:12345-192.168.204.51@tcp:101:cat.0 Request processed in 658us (951us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787098244.571354:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:1.0:1787098244.576695:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098244.576776:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098244.576868:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059934848 00000100:00100000:0.0:1787098244.576878:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059934848 00000100:00100000:0.0:1787098244.576953:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:0.0:1787098244.576966:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+40:11453:x1873908059934848:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1787098244.577233:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+41:11453:x1873908059934848:12345-192.168.204.51@tcp:35:cat.0 Request processed in 267us (547us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787098244.577241:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:3.0:1787098244.577710:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059934976 00000100:00100000:3.0:1787098244.577780:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059934976 00000100:00100000:3.0:1787098244.577828:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1787098244.577837:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+41:2373:x1873908059934976:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098244.577858:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098244.577883:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b7 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.577901:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:3.0:1787098244.577907:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098244.578041:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+40:2373:x1873908059934976:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 206us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098244.578049:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1787098244.680894:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098244.681011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059935232 00000100:00100000:3.0:1787098244.681033:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059935232 00000100:00100000:3.0:1787098244.681105:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 154 00000100:00100000:3.0:1787098244.681116:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+40:11459:x1873908059935232:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:3.0:1787098244.681144:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098244.681148:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787098244.681179:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528768d expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.681204:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098244.681209:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098244.681223:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014512f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876be expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.681585:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.681602:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b0 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.681611:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.681645:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b0 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.681659:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b0 expref: 40 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098244.681676:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077762688:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098244.682534:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098244.689786:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077762688:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098244.689821:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098244.692915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098244.693195:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059935360 00000100:00100000:3.0:1787098244.693206:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059935360 00010000:00010000:3.0:1787098244.693255:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b0 expref: 41 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098244.693327:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1787098244.693361:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+41:2374:x1873908059935360:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098244.693378:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098244.693385:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b0 expref: 41 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.693399:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b0 expref: 41 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.693424:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b0145105 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876b0 expref: 41 pid: 5844 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.693441:0:11681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:3.0:1787098244.693446:0:11681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.693456:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.693463:0:11681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.693499:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098244.693557:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+40:2374:x1873908059935360:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 198us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098244.693565:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00010000:00010000:0.0:1787098244.693715:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098244.693727:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098244.693747:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787098244.693900:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014512f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876be expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098244.693919:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876be expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098244.693951:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:0.0:1787098244.693953:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787098244.693955:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7000, rc 0) 00000100:00100000:0.0:1787098244.693983:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+40:11459:x1873908059935232:12345-192.168.204.51@tcp:101:dd.0 Request processed in 12870us (13101us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787098244.693990:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 154 00000100:00100000:2.0:1787098244.703068:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098244.703321:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059935616 00000100:00100000:1.0:1787098244.703345:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059935616 00000100:00100000:1.0:1787098244.703415:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:1.0:1787098244.703426:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+40:11459:x1873908059935616:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:1.0:1787098244.703958:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.703976:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.703988:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787098244.704054:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787098244.704079:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005df15522 reply state 0000000032107404 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098244.704089:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787098244.704242:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+43:11459:x1873908059935616:12345-192.168.204.51@tcp:36:dd.0 Request processed in 815us (1181us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787098244.704256:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 155 00000020:00080000:1.0:1787098244.704273:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787098244.715027:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098244.715058:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098244.715066:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098244.715074:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098244.715079:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098244.715087:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098244.715104:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:0.0:1787098244.715107:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098244.715112:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098244.715127:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145144 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098244.971507:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098244.971607:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059935744 00000100:00100000:3.0:1787098244.971617:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059935744 00000100:00100000:3.0:1787098244.971683:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:3.0:1787098244.971693:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+42:11473:x1873908059935744:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:3.0:1787098244.971856:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098244.971878:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014514b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876c5 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.971987:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972005:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972020:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972035:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972042:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972049:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972148:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972160:0:6853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876be expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972168:0:6853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972203:0:6853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876be expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098244.972224:0:6853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876be expref: 43 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098244.972239:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d72065e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077762816:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098244.972384:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7104d7e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098244.979351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098244.979431:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059936000 00000100:00100000:0.0:1787098244.979441:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059936000 00000100:00100000:0.0:1787098244.979509:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1787098244.979520:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+44:5610:x1873908059936000:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787098244.979874:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+45:5610:x1873908059936000:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 355us (532us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787098244.979882:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1787098244.980060:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d72065e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077762816:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098244.980086:0:6853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098244.985507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098244.985637:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059936128 00000100:00100000:1.0:1787098244.985649:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059936128 00010000:00010000:1.0:1787098244.985705:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876be expref: 45 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098244.985756:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1787098244.985768:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+45:2374:x1873908059936128:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098244.985786:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098244.985793:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876be expref: 45 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.985807:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876be expref: 45 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.985829:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145136 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876be expref: 45 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.985850:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:1.0:1787098244.985855:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.985864:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.985872:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098244.985905:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787098244.986165:0:6853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986175:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098244.986224:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787098244.986229:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098244.986251:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986264:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986274:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986312:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986318:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986335:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098244.986340:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986347:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986357:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:2.0:1787098244.986359:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098244.986363:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986369:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145152 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986382:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986388:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986393:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986397:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098244.986400:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986406:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986424:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92800) 00010000:00010000:2.0:1787098244.986426:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098244.986429:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986434:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986474:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014514b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876c5 expref: 45 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986490:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876c5 expref: 44 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098244.986497:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:2.0:1787098244.986500:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098244.986502:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7600, rc 0) 00000100:00100000:2.0:1787098244.986562:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+44:11473:x1873908059935744:12345-192.168.204.51@tcp:101:stat.0 Request processed in 14870us (15065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098244.986570:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:1.0:1787098244.987481:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+43:2374:x1873908059936128:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1708us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098244.987492:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:2.0:1787098245.102762:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098245.103804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059936384 00000100:00100000:3.0:1787098245.103817:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059936384 00000100:00100000:1.0:1787098245.104955:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00100000:1.0:1787098245.104981:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+43:11479:x1873908059936384:12345-192.168.204.51@tcp:36:truncate.0 00010000:00010000:1.0:1787098245.105327:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098245.105361:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876c5 expref: 43 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098245.105387:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:1.0:1787098245.105392:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787098245.105611:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098245.105626:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098245.105636:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787098245.105951:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787098245.105977:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085fc6851 reply state 0000000059f898b6 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098245.105986:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787098245.106766:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+45:11479:x1873908059936384:12345-192.168.204.51@tcp:36:truncate.0 Request processed in 1786us (4008us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787098245.106778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 157 00000020:00080000:1.0:1787098245.106784:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787098245.108703:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.108722:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.108730:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.108736:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098245.108740:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.108748:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.108764:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:3.0:1787098245.108780:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098245.108786:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.108793:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b0145167 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787098245.109382:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098245.260364:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098245.260460:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059936512 00000100:00100000:0.0:1787098245.260469:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059936512 00000100:00100000:0.0:1787098245.260530:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:0.0:1787098245.260541:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+44:11493:x1873908059936512:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:0.0:1787098245.260566:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098245.260592:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014516e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876cc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260675:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260690:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260702:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260717:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260747:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260754:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260858:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260866:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260873:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098245.260907:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787098245.260911:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098245.260945:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260957:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260967:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260973:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260980:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.260997:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098245.261001:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261007:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261018:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:0.0:1787098245.261022:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098245.261026:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261032:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261048:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261053:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261059:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261064:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098245.261066:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261072:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261090:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7208701400) 00010000:00010000:0.0:1787098245.261093:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098245.261095:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261100:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014517c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261133:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014516e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876cc expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261146:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876cc expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.261153:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:0.0:1787098245.261155:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098245.261156:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694c00, rc 0) 00000100:00100000:0.0:1787098245.261331:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+45:11493:x1873908059936512:12345-192.168.204.51@tcp:101:stat.0 Request processed in 791us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098245.261339:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:2.0:1787098245.351210:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098245.351331:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059936768 00000100:00100000:3.0:1787098245.351343:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059936768 00000100:00100000:3.0:1787098245.351407:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:3.0:1787098245.351417:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+45:11503:x1873908059936768:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098245.351439:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098245.351461:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014518a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876d3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098245.351628:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787098245.351783:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014518a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876d3 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.351797:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:3.0:1787098245.351800:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098245.351806:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014518a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876d3 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.351825:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7c00, rc 0) 00000100:00100000:3.0:1787098245.352159:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+46:11503:x1873908059936768:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 742us (958us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787098245.352167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:3.0:1787098245.355442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098245.355555:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059937024 00000100:00100000:0.0:1787098245.355570:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059937024 00000100:00100000:0.0:1787098245.355633:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1787098245.355653:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+46:11503:x1873908059937024:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1787098245.355953:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+47:11503:x1873908059937024:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 301us (522us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787098245.355962:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000040:00080000:0.0:1787098245.392985:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787098245.392995:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787098245.393350:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787098245.393360:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787098245.407391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098245.407500:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059937280 00000100:00100000:0.0:1787098245.407511:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059937280 00000100:00100000:0.0:1787098245.407577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00100000:0.0:1787098245.407587:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+47:11509:x1873908059937280:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098245.407610:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098245.407632:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145198 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876da expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.407754:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.407769:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876cc expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.407779:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.407815:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876cc expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.407958:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876cc expref: 48 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098245.407973:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077762944:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098245.408188:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722b7b1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787098245.410574:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098245.410631:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077762944:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098245.410659:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098245.410735:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059937408 00000100:00100000:2.0:1787098245.410742:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059937408 00010000:00010000:2.0:1787098245.410837:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876cc expref: 49 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098245.410945:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:2.0:1787098245.410955:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+49:2374:x1873908059937408:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098245.410978:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098245.410985:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876cc expref: 49 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.410997:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876cc expref: 49 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.411028:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876cc expref: 49 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.411043:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:2.0:1787098245.411048:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.411056:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.411063:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.411090:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098245.411140:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+48:2374:x1873908059937408:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 186us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098245.411147:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00010000:00010000:0.0:1787098245.411201:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.411209:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098245.411227:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787098245.411415:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145198 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876da expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.411430:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876da expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.411437:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:0.0:1787098245.411440:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787098245.411442:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695200, rc 0) 00000100:00100000:0.0:1787098245.411467:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+48:11509:x1873908059937280:12345-192.168.204.51@tcp:101:bash.0 Request processed in 3882us (4087us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787098245.411473:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00100000:3.0:1787098245.415173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098245.415306:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059937664 00000100:00100000:1.0:1787098245.415317:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059937664 00000100:00100000:1.0:1787098245.415377:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 161 00000100:00100000:1.0:1787098245.415387:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+48:11509:x1873908059937664:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:1.0:1787098245.415675:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098245.415693:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098245.415703:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787098245.415752:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1787098245.415775:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000776500ba reply state 0000000041fa9967 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098245.415784:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787098245.415870:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+51:11509:x1873908059937664:12345-192.168.204.51@tcp:36:bash.0 Request processed in 484us (715us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787098245.415877:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 161 00000020:00080000:1.0:1787098245.415882:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787098245.418954:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.418973:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.418980:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.419001:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098245.419006:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.419013:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.419029:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:0.0:1787098245.419032:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098245.419037:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.419043:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b01451ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098245.421961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098245.422031:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059937792 00000100:00100000:2.0:1787098245.422052:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059937792 00000100:00100000:2.0:1787098245.422110:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:2.0:1787098245.422119:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+50:11509:x1873908059937792:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1787098245.422144:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098245.422163:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b01451b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876e1 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.422240:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.422254:0:6853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876da expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.422263:0:6853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.422338:0:6853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876da expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.422351:0:6853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876da expref: 51 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098245.422365:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241c5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077763072:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098245.422447:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7105a86480 going to sleep for 11 seconds 00000100:00100000:1.0:1787098245.425156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098245.425348:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241c5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077763072:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098245.425374:0:6853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098245.425835:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059937920 00000100:00100000:0.0:1787098245.425843:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059937920 00010000:00010000:0.0:1787098245.425880:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876da expref: 52 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098245.425972:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:0.0:1787098245.425982:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+52:2373:x1873908059937920:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098245.425996:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098245.426003:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876da expref: 52 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.426014:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876da expref: 52 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.426146:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014519f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876da expref: 52 pid: 5843 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.426161:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:0.0:1787098245.426166:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.426175:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.426182:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.426209:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098245.426270:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+51:2373:x1873908059937920:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 288us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098245.426277:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00010000:00010000:2.0:1787098245.426348:0:6853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.426361:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098245.426403:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787098245.426407:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098245.426426:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.426454:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b01451b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876e1 expref: 51 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.426467:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876e1 expref: 50 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.426473:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:2.0:1787098245.426476:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098245.426479:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622a00, rc 0) 00000100:00100000:2.0:1787098245.426504:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+50:11509:x1873908059937792:12345-192.168.204.51@tcp:101:bash.0 Request processed in 4386us (4558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098245.426511:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:1.0:1787098245.429337:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098245.429376:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059938176 00000100:00100000:2.0:1787098245.429387:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059938176 00000100:00100000:2.0:1787098245.429446:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1787098245.429457:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+50:11509:x1873908059938176:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1787098245.429760:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+51:11509:x1873908059938176:12345-192.168.204.51@tcp:35:bash.0 Request processed in 293us (421us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787098245.429769:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00010000:00010000:1.0:1787098245.519646:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098245.539081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098245.542433:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059938432 00000100:00100000:2.0:1787098245.542450:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059938432 00000100:00100000:2.0:1787098245.542530:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:2.0:1787098245.542540:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+51:11519:x1873908059938432:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098245.542565:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098245.542589:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b01451c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876e8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098245.542710:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787098245.542830:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b01451c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876e8 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.542846:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:2.0:1787098245.542848:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098245.542853:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b01451c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876e8 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.542867:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622800, rc 0) 00000100:00100000:2.0:1787098245.543079:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+52:11519:x1873908059938432:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 539us (4008us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787098245.543087:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:1.0:1787098245.564172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098245.564526:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059938560 00000100:00100000:0.0:1787098245.564537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059938560 00000100:00100000:0.0:1787098245.564659:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:0.0:1787098245.564669:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+52:11519:x1873908059938560:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1787098245.564757:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.564775:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.564786:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.564816:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.564823:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.564831:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.564946:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.564955:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.564962:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787098245.565004:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565017:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565023:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565039:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565045:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098245.565049:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565064:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565077:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:0.0:1787098245.565081:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098245.565269:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565445:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01451d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565465:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565471:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565477:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565482:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098245.565485:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565492:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565500:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7208701400) 00010000:00010000:0.0:1787098245.565503:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098245.565506:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565524:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01451d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565540:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565546:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565552:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565557:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098245.565561:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565566:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565574:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:0.0:1787098245.565576:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098245.565579:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098245.565584:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01451de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098245.565766:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+52:11519:x1873908059938560:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1096us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098245.565775:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:1.0:1787098245.574091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098245.575520:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059938816 00000100:00100000:3.0:1787098245.575536:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059938816 00000100:00100000:3.0:1787098245.575604:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1787098245.575614:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+52:11519:x1873908059938816:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1787098245.575886:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+53:11519:x1873908059938816:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 273us (1809us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787098245.575894:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1787098245.648377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098245.648780:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059939072 00000100:00100000:2.0:1787098245.648791:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059939072 00000100:00100000:2.0:1787098245.648859:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:2.0:1787098245.648869:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+53:11522:x1873908059939072:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098245.648893:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098245.648924:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b01451e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876ef expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649017:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649031:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649043:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649058:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649066:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649073:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649212:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01451fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649222:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01451fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649229:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01451fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098245.649239:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787098245.649535:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649543:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649557:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649563:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098245.649567:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649574:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649586:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:2.0:1787098245.649589:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098245.649593:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649599:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622200/0xb1d871f9b01451ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649611:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649616:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649621:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649625:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098245.649627:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649642:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649649:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7203ead500) 00010000:00010000:2.0:1787098245.649651:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098245.649653:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649659:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01451f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649798:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b01451e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876ef expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649813:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01451fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876ef expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.649820:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:2.0:1787098245.649822:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098245.649824:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623000, rc 0) 00000100:00100000:2.0:1787098245.649958:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+55:11522:x1873908059939072:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1089us (1590us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787098245.649966:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:1.0:1787098245.654939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098245.655352:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059939200 00000100:00100000:3.0:1787098245.655363:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059939200 00000100:00100000:3.0:1787098245.655434:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1787098245.655445:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+55:2376:x1873908059939200:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098245.655463:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098245.655491:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623000/0xb1d871f9b01451fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876ef expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.655512:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:3.0:1787098245.655517:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098245.655627:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+54:2376:x1873908059939200:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 184us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098245.655635:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1787098245.668127:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098245.669938:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059939328 00000100:00100000:2.0:1787098245.669954:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059939328 00000100:00100000:2.0:1787098245.670027:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:2.0:1787098245.670038:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+54:11522:x1873908059939328:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1787098245.670134:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.670154:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.670166:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.670194:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.670202:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.670208:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.670215:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098245.670220:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.670228:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.670240:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:2.0:1787098245.670243:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098245.670247:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.670253:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098245.670393:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+54:11522:x1873908059939328:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 357us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098245.670401:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:0.0:1787098245.675895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098245.675965:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059939584 00000100:00100000:3.0:1787098245.675976:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059939584 00000100:00100000:3.0:1787098245.676046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1787098245.676057:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+54:11522:x1873908059939584:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1787098245.676525:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+55:11522:x1873908059939584:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 468us (640us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787098245.676534:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1787098245.825545:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098245.825632:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059939840 00000100:00100000:3.0:1787098245.825644:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059939840 00000100:00100000:3.0:1787098245.825709:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:3.0:1787098245.825720:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+55:11540:x1873908059939840:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:3.0:1787098245.825746:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098245.825768:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014520f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876f6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.825877:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145216 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.825893:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.825919:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098245.825931:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787098245.826071:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014520f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876f6 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.826093:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876f6 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.826101:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:3.0:1787098245.826116:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787098245.826120:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6000, rc 0) 00000100:00100000:3.0:1787098245.826186:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11540:x1873908059939840:12345-192.168.204.51@tcp:101:cat.0 Request processed in 468us (653us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787098245.826193:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:1.0:1787098245.847246:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098245.847445:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059939968 00000100:00100000:2.0:1787098245.847457:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059939968 00000100:00100000:2.0:1787098245.847584:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:2.0:1787098245.847595:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11541:x1873908059939968:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098245.847620:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098245.847652:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52876fd expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.847716:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b014522b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.847729:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b014522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.847739:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b014522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098245.847802:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787098245.847806:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098245.847831:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b014522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.847858:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b0145224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876fd expref: 59 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.847875:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b014522b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876fd expref: 58 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.847897:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:2.0:1787098245.847901:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098245.847916:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623800, rc 0) 00000100:00100000:2.0:1787098245.848207:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11541:x1873908059939968:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 613us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098245.848214:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:0.0:1787098245.853148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098245.853277:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059940352 00000100:00100000:2.0:1787098245.853309:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059940352 00000100:00100000:2.0:1787098245.853364:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1787098245.853373:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11541:x1873908059940352:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1787098245.853922:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11541:x1873908059940352:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 548us (783us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787098245.853931:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:1.0:1787098245.856898:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098245.856996:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059940480 00000100:00100000:2.0:1787098245.857008:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059940480 00000100:00100000:2.0:1787098245.857090:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1787098245.857100:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7208e33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11541:x1873908059940480:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:2.0:1787098245.857116:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787098245.857147:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01451bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876e1 expref: 59 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.857169:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876f6 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.857183:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01450c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876a2 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098245.857209:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701e00) 00010000:00010000:2.0:1787098245.857220:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098245.857302:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7208e33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+56:11541:x1873908059940480:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 179us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098245.857311:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1787098245.859763:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098245.859849:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059940608 00000100:00100000:3.0:1787098245.859859:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059940608 00000100:00100000:3.0:1787098245.859942:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:3.0:1787098245.859953:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+56:11541:x1873908059940608:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:3.0:1787098245.860276:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.860322:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.860333:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787098245.860517:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787098245.860609:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+56:11541:x1873908059940608:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 657us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098245.860619:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:0.0:1787098245.890090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098245.890394:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059940736 00000100:00100000:3.0:1787098245.890405:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059940736 00000100:00100000:3.0:1787098245.890476:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:3.0:1787098245.890487:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+56:11543:x1873908059940736:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098245.890512:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098245.890537:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287704 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890619:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890646:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890658:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890675:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890682:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890689:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890792:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890801:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890808:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098245.890844:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787098245.890849:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098245.890868:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890891:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890900:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890923:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890930:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890937:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098245.890942:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.890950:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891458:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098245.891463:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098245.891479:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891486:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145240 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891512:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891518:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891532:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891538:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098245.891541:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891547:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891557:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92400) 00010000:00010000:3.0:1787098245.891560:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098245.891563:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891569:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891612:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287704 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891639:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287704 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098245.891647:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92a00) 00010000:00010000:3.0:1787098245.891649:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098245.891652:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7600, rc 0) 00000100:00100000:3.0:1787098245.891724:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11543:x1873908059940736:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1239us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098245.891740:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:1.0:1787098246.172224:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098246.172272:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098246.172319:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059940864 00000100:00100000:2.0:1787098246.172331:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059940864 00000100:00100000:2.0:1787098246.172387:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 287 00000100:00100000:2.0:1787098246.172400:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2376:x1873908059940864:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098246.172476:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2376:x1873908059940864:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098246.172483:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 287 00000100:00100000:1.0:1787098246.172807:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098246.173012:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059940992 00000100:00100000:0.0:1787098246.173017:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059940992 00000100:00100000:0.0:1787098246.173064:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:0.0:1787098246.173222:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+57:2375:x1873908059940992:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098246.173273:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+57:2375:x1873908059940992:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 201us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098246.173304:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:2.0:1787098246.173373:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059941248 00000100:00100000:2.0:1787098246.173378:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059941248 00000100:00100000:2.0:1787098246.173428:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:2.0:1787098246.173436:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2375:x1873908059941248:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098246.173468:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2375:x1873908059941248:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098246.173474:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00080000:0.0:1787098246.173764:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787098246.178616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098246.178710:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059941120 00000100:00100000:0.0:1787098246.178720:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059941120 00000100:00100000:0.0:1787098246.178806:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:0.0:1787098246.178818:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059941120:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098246.179243:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2376:x1873908059941120:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 426us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098246.179252:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:2.0:1787098246.179556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098246.179592:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059941376 00000100:00100000:2.0:1787098246.179598:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059941376 00000100:00100000:2.0:1787098246.179639:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:2.0:1787098246.179647:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2376:x1873908059941376:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098246.179706:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2376:x1873908059941376:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098246.179713:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00080000:1.0:1787098246.180939:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787098246.180947:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098246.291914:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077763200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098246.293819:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098246.296564:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077763200 00000100:00100000:1.0:1787098246.296581:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077763200 00000100:00100000:1.0:1787098246.296650:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787098246.296661:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077763200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787098246.296699:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098246.296788:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077763200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098246.296795:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787098246.296830:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098246.296910:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077763200:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787098246.368412:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1787098246.368429:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:0.0:1787098246.415566:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787098246.415576:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787098246.415612:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787098246.415618:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787098246.415745:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077763328:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787098246.415848:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203c333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098246.425902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098246.425994:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059941504 00000100:00100000:1.0:1787098246.426005:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059941504 00000100:00100000:3.0:1787098246.426030:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077763328:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787098246.426074:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:1.0:1787098246.426087:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11554:x1873908059941504:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787098246.426128:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787098246.426237:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11554:x1873908059941504:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 153us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098246.426254:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:2.0:1787098246.442869:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.443208:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059941632 00000100:00100000:3.0:1787098246.443221:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059941632 00000100:00100000:3.0:1787098246.443328:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:3.0:1787098246.443340:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11554:x1873908059941632:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787098246.443428:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443446:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443459:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443477:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443484:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443491:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443521:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443530:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443550:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098246.443594:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787098246.443599:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098246.443613:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443639:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443646:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443653:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443660:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098246.443665:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443673:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443685:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:3.0:1787098246.443688:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098246.443693:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443698:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145255 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443726:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443734:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443740:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443745:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098246.443748:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443754:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443762:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d7207e92200) 00010000:00010000:3.0:1787098246.443764:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098246.443767:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443772:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014525c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443789:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443795:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443801:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443813:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098246.443816:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443822:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443830:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92a00) 00010000:00010000:3.0:1787098246.443833:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098246.443836:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.443842:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145263 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098246.444131:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11554:x1873908059941632:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 792us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098246.444140:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:3.0:1787098246.449130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098246.449215:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059941888 00000100:00100000:2.0:1787098246.449227:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059941888 00000100:00100000:2.0:1787098246.449312:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:2.0:1787098246.449322:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11554:x1873908059941888:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098246.449344:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098246.449363:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b014526a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528770b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449482:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449497:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449509:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098246.449520:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787098246.449632:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449640:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449647:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449663:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098246.449667:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449675:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449687:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92a00) 00010000:00010000:2.0:1787098246.449689:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098246.449694:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449700:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145271 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449741:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b014526a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528770b expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449751:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:2.0:1787098246.449753:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098246.449757:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b014526a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528770b expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.449765:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623600, rc 0) 00000100:00100000:2.0:1787098246.449962:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11554:x1873908059941888:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 640us (847us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787098246.449971:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:3.0:1787098246.453842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098246.454077:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059942016 00000100:00100000:2.0:1787098246.454103:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059942016 00000100:00100000:2.0:1787098246.454162:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:2.0:1787098246.454173:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11554:x1873908059942016:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787098246.454211:0:6853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787098246.454363:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11554:x1873908059942016:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 191us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098246.454373:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:2.0:1787098246.460574:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.462108:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059942272 00000100:00100000:3.0:1787098246.462122:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059942272 00000100:00100000:3.0:1787098246.462193:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 175 00000100:00100000:3.0:1787098246.462203:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11554:x1873908059942272:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787098246.462226:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098246.462230:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787098246.462268:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b014522b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52876fd expref: 58 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.462325:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098246.462330:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098246.462343:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014527f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287712 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787098246.462785:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787098246.465540:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.465561:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.465572:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.465665:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014527f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287712 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.465688:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287712 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.465697:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7207e92400) 00010000:00010000:3.0:1787098246.465700:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098246.465704:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030c00, rc 0) 00000100:00100000:3.0:1787098246.465789:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11554:x1873908059942272:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3587us (5228us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787098246.465811:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 175 00000100:00100000:2.0:1787098246.480710:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098246.480866:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059942528 00000100:00100000:0.0:1787098246.480877:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059942528 00000100:00100000:0.0:1787098246.480953:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 176 00000100:00100000:0.0:1787098246.480977:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11554:x1873908059942528:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787098246.481045:0:6853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098246.481073:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145286 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287712 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481093:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7207e92400) 00010000:00010000:0.0:1787098246.481105:0:6853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787098246.481130:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481144:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481154:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481168:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481174:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481180:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481258:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481311:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481319:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481325:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098246.481329:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481337:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481346:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:0.0:1787098246.481349:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098246.481353:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481359:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145294 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481370:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481375:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481381:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481386:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098246.481395:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481401:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481409:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbff21ef8 (ffff8d7208701b00) 00010000:00010000:0.0:1787098246.481411:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098246.481414:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.481419:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014529b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbff21ef8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098246.481509:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11554:x1873908059942528:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 535us (808us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787098246.481517:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 176 00000100:00100000:1.0:1787098246.485193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098246.486221:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059942656 00000100:00100000:2.0:1787098246.486236:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059942656 00000100:00100000:2.0:1787098246.486344:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 177 00000100:00100000:2.0:1787098246.486356:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11554:x1873908059942656:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098246.486381:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098246.486405:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287719 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.486442:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.486456:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.486465:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.486571:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287719 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.486604:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287719 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.486612:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:2.0:1787098246.486625:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787098246.486629:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623e00, rc 0) 00000100:00100000:2.0:1787098246.486697:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11554:x1873908059942656:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 343us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098246.486704:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 177 00000100:00100000:1.0:1787098246.494500:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098246.499232:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059942912 00000100:00100000:0.0:1787098246.499248:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059942912 00000100:00100000:0.0:1787098246.499332:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:0.0:1787098246.499342:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11554:x1873908059942912:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787098246.499421:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.499438:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.499449:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787098246.499745:0:6853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1787098246.499765:0:6853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344755484424ns, next at 345755481873ns, rc = 0 00000004:00010000:0.0:1787098246.499859:0:6853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2775d8e reply state 000000000e4a0550 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098246.499870:0:6853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787098246.499987:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+61:11554:x1873908059942912:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 645us (5499us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787098246.499995:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:0.0:1787098246.504629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:3.0:1787098246.505203:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.505218:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.505225:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.505232:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098246.505236:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.505244:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.505261:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:3.0:1787098246.505264:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787098246.505269:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.505274:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01452b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098246.506151:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059943040 00000100:00100000:2.0:1787098246.506163:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059943040 00000100:00100000:2.0:1787098246.506223:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:2.0:1787098246.506234:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11554:x1873908059943040:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098246.506261:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098246.506310:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287720 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.506370:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287720 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.506386:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287720 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.506407:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:2.0:1787098246.506411:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098246.506428:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623600, rc 0) 00000100:00100000:2.0:1787098246.506499:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+61:11554:x1873908059943040:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 268us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098246.506507:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:3.0:1787098246.516509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.516551:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059943168 00000100:00100000:3.0:1787098246.516561:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059943168 00000100:00100000:3.0:1787098246.516616:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:3.0:1787098246.516639:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059943168:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787098246.516998:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059943168:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 371us (500us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787098246.517020:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:2.0:1787098246.524432:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.524515:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059943424 00000100:00100000:3.0:1787098246.524525:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059943424 00000100:00100000:3.0:1787098246.524585:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:3.0:1787098246.524596:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+61:11554:x1873908059943424:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787098246.524836:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+62:11554:x1873908059943424:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 241us (415us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787098246.524845:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:3.0:1787098246.531510:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098246.531630:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059943680 00000100:00100000:0.0:1787098246.531640:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059943680 00000100:00100000:0.0:1787098246.531697:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 180 00000100:00100000:0.0:1787098246.531707:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72065e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+62:11554:x1873908059943680:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787098246.531817:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72065e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+62:11554:x1873908059943680:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098246.531825:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 180 00000100:00100000:0.0:1787098246.535236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098246.535391:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059943808 00000100:00100000:2.0:1787098246.535401:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059943808 00000100:00100000:2.0:1787098246.535453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 181 00000100:00100000:2.0:1787098246.535462:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+62:11554:x1873908059943808:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098246.535482:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098246.535501:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b01452be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287727 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.535587:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01452c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.535600:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01452c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.535611:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01452c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098246.535657:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098246.535674:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01452c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.535700:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b01452be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287727 expref: 64 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.535717:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01452c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287727 expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098246.535741:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:2.0:1787098246.535744:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787098246.535747:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623800, rc 0) 00000100:00100000:2.0:1787098246.535808:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+63:11554:x1873908059943808:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 346us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098246.535816:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 181 00000100:00100000:2.0:1787098246.541104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098246.541339:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059943936 00000100:00100000:0.0:1787098246.541349:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059943936 00000100:00100000:0.0:1787098246.541400:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1787098246.541410:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059943936:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098246.541429:0:12017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098246.541451:0:12017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528772e expref: -99 pid: 12017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098246.541478:0:12017:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a84f486, blocks: 0x1 00010000:00010000:0.0:1787098246.541498:0:12017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1787098246.541516:0:12017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098246.541526:0:12017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528772e expref: 8 pid: 12017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.541547:0:12017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528772e expref: 8 pid: 12017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.541560:0:12017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695200, rc 0) 00000100:00100000:0.0:1787098246.541632:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2374:x1873908059943936:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 224us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098246.541641:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00010000:00010000:1.0:1787098246.543434:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098246.545596:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098246.545802:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059944192 00000100:00100000:0.0:1787098246.545811:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059944192 00000100:00100000:0.0:1787098246.545865:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 182 00000100:00100000:0.0:1787098246.545874:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+63:11554:x1873908059944192:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787098246.546184:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+63:11554:x1873908059944192:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 309us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098246.546194:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 182 00000100:00100000:3.0:1787098246.549185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098246.549329:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059944320 00000100:00100000:0.0:1787098246.549340:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059944320 00000100:00100000:0.0:1787098246.549396:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1787098246.549405:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+8:11554:x1873908059944320:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098246.549426:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098246.549447:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287735 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.549494:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528772e expref: 9 pid: 12017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.549502:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098246.549506:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098246.549510:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.549545:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528772e expref: 9 pid: 12017 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.549558:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528772e expref: 9 pid: 12017 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098246.549571:0:6701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1873908077763456:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098246.549669:0:6701:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206767840 going to sleep for 11 seconds 00000100:00100000:2.0:1787098246.553325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098246.553411:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059944448 00000100:00100000:1.0:1787098246.553421:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059944448 00010000:00010000:1.0:1787098246.553474:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528772e expref: 10 pid: 12017 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098246.553513:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:1.0:1787098246.553523:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+10:2373:x1873908059944448:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098246.553538:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098246.553560:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528772e expref: 10 pid: 12017 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.553574:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528772e expref: 10 pid: 12017 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.553598:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098246.553603:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098246.553611:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.553631:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.553692:0:11178:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098246.553707:0:11178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba15c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11178:1873908077763584:192.168.204.51@tcp:105: 00000100:00100000:1.0:1787098246.553802:0:11178:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73a80 going to sleep for 11 seconds 00010000:00010000:0.0:1787098246.554330:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255501cb/0xb1d871f9b01452cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528772e expref: 10 pid: 12017 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098246.554350:0:6701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1873908077763456:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098246.554376:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 9 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.554387:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:0.0:1787098246.554432:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+9:11554:x1873908059944320:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 5029us (5257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098246.554442:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1787098246.559609:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098246.559769:0:11178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba15c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11178:1873908077763584:192.168.204.51@tcp:105: 00010000:00010000:1.0:1787098246.559805:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098246.559862:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059944448:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 6340us (6587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098246.559874:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1787098246.560024:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059944576 00000100:00100000:3.0:1787098246.560032:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059944576 00002000:00100000:3.0:1787098246.560078:0:6707:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d7106021880 x1873908059944576/t0(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:422/0 lens 504/0 e 0 to 0 dl 1787098257 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787098246.560088:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7106021880 with x1873908059944576 ext(0->8) 00002000:00010000:3.0:1787098246.560093:0:6707:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d7106021880 00000100:00100000:3.0:1787098246.560122:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1787098246.560131:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059944576:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787098246.560598:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+10:2373:x1873908059944576:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 466us (998us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787098246.560607:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00002000:00100000:3.0:1787098246.560625:0:6707:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d7106021880 x1873908059944576/t4294967314(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:422/0 lens 504/448 e 0 to 0 dl 1787098257 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787098246.560646:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7106021880 with x1873908059944576 ext(0->8) 00002000:00010000:3.0:1787098246.560650:0:6707:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d7106021880 00000100:00100000:1.0:1787098246.577178:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098246.580920:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059944704 00000100:00100000:0.0:1787098246.580937:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059944704 00000100:00100000:0.0:1787098246.581823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 183 00000100:00100000:0.0:1787098246.581839:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+63:11554:x1873908059944704:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787098246.681524:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+63:11554:x1873908059944704:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 99677us (104343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098246.681540:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 183 00000001:00080000:1.0:1787098246.681580:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1787098246.681588:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:1.0:1787098246.683720:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1787098246.684592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.685172:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059944832 00000100:00100000:3.0:1787098246.685185:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059944832 00000100:00100000:3.0:1787098246.685249:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:3.0:1787098246.685258:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+10:2373:x1873908059944832:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787098246.685840:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077763712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787098246.685907:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098246.686790:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077763712 00000100:00100000:3.0:1787098246.686799:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077763712 00000100:00100000:3.0:1787098246.686855:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787098246.686863:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077763712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787098246.686884:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1787098246.686926:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a84f483, atime: 0x6a84f483, ctime: 0x6a84f483, blocks: 0xb 00010000:00010000:3.0:1787098246.686935:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.686950:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1787098246.686954:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098246.686960:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.686975:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.686984:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.687013:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.687031:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1787098246.687821:0:5866:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d7105a86a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787098246.687827:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d72411bc600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d7105a86600 00000020:00080000:1.0:1787098246.687830:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d72411bc500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7241adb000 00000001:00080000:1.0:1787098246.687849:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00080000:1.0:1787098246.687903:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1787098246.688021:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787098246.688140:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787098246.688180:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077763840:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787098246.688220:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098246.688404:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077763840 00000100:00100000:1.0:1787098246.688410:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077763840 00000100:00100000:1.0:1787098246.688447:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787098246.688454:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077763840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787098246.688624:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787098246.688628:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787098246 00002000:00010000:1.0:1787098246.688630:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787098246.688632:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787098246 -> 1787098246 00002000:00010000:1.0:1787098246.688634:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787098246.688673:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1873908077763840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (452us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787098246.688680:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1787098246.688948:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d723ba14a80/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787098246.688956:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077763840:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787098246.691602:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098246.691626:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.691641:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030400 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098246.691646:0:6716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.691658:0:6716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.691696:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.691704:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aa71ab0/0xb1d871f9b01452da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.691728:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098246.691730:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098246.691732:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098246.692824:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1873908077763712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5952us (6907us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787098246.692838:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787098246.702197:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787098246.702210:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787098246.702242:0:3310:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d7106023800 x1873908077763712/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787098262 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787098246.702257:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7106023800/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787098246.702264:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077763712:0@lo:6:osp-syn-1-0.0 00000040:00080000:1.0:1787098246.737555:0:12526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098246.737565:0:12526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098246.737606:0:12526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787098246.737612:0:12526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787098246.755379:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+10:2373:x1873908059944832:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 70111us (70783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098246.755394:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000001:00080000:3.0:1787098246.755433:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1787098246.783796:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.785395:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059945088 00000100:00100000:3.0:1787098246.785411:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059945088 00000100:00100000:3.0:1787098246.785484:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 184 00000100:00100000:3.0:1787098246.785496:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:11554:x1873908059945088:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787098246.785561:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098246.785591:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b01452c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287727 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.785608:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:3.0:1787098246.785613:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098246.785641:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.785654:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.785675:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098246.785938:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014e2056b reply state 000000006c510a98 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098246.785948:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787098246.786070:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+19:11554:x1873908059945088:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 576us (2283us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787098246.786078:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 184 00000100:00100000:0.0:1787098246.805848:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:3.0:1787098246.806160:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.806172:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.806179:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.806185:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098246.806189:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.806197:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.806214:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:3.0:1787098246.806217:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098246.806222:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.806243:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01452e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098246.807857:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059945216 00000100:00100000:0.0:1787098246.807874:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059945216 00000100:00100000:0.0:1787098246.807964:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1787098246.807975:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059945216:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787098246.808197:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787098246.808201:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787098246 -> 1787098245 00002000:00010000:0.0:1787098246.808204:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787098243 00002000:00010000:0.0:1787098246.808206:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787098246 -> 1787098245 00002000:00010000:0.0:1787098246.808209:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787098246.808307:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059945216:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 333us (2465us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787098246.808316:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:1.0:1787098246.813972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.814043:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059945472 00000100:00100000:3.0:1787098246.814055:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059945472 00000100:00100000:3.0:1787098246.814119:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:3.0:1787098246.814129:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+18:11554:x1873908059945472:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787098246.814202:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.814221:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287719 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.814229:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.814262:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287719 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.814301:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287719 expref: 18 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098246.814316:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d710595d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077763968:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098246.814402:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72209dff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787098246.820761:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d710595d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077763968:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098246.820791:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098246.822587:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.822657:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059945600 00000100:00100000:3.0:1787098246.822667:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059945600 00010000:00010000:3.0:1787098246.822702:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287719 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098246.822749:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:3.0:1787098246.822799:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+19:2374:x1873908059945600:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098246.822814:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098246.822821:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287719 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.822835:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287719 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.822858:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b01452a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287719 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.822872:0:11681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:3.0:1787098246.822877:0:11681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.822897:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.822905:0:11681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.822930:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098246.822994:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+18:2374:x1873908059945600:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 196us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098246.823003:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00010000:00010000:3.0:1787098246.823033:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.823040:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.823068:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.823076:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.823081:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.823087:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098246.823092:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.823099:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.823108:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:3.0:1787098246.823111:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787098246.823114:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.823119:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098246.823168:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+17:11554:x1873908059945472:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 9040us (9205us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787098246.823176:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:1.0:1787098246.829965:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.830032:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059945728 00000100:00100000:3.0:1787098246.830044:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059945728 00000100:00100000:3.0:1787098246.830105:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:3.0:1787098246.830115:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2376:x1873908059945728:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787098246.830164:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.830187:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.830197:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787098246.830201:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787098246.830205:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.830241:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.830256:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 8 pid: 6701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098246.830270:0:6702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d710595d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1873908077764096:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098246.830391:0:6702:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72209dff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098246.843175:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098246.843223:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059945856 00000100:00100000:1.0:1787098246.843233:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059945856 00010000:00010000:1.0:1787098246.843275:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 9 pid: 6701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098246.843339:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:1.0:1787098246.843348:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2373:x1873908059945856:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098246.843364:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098246.843387:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 9 pid: 6701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843401:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 9 pid: 6701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843430:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787098246.843434:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787098246.843441:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843452:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843473:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098246.843525:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2373:x1873908059945856:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 177us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098246.843532:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00010000:00010000:1.0:1787098246.843582:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004291d4e8/0xb1d871f9b01452d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287735 expref: 8 pid: 6701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098246.843599:0:6702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d710595d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1873908077764096:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098246.843627:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843637:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843644:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843667:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843675:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843683:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843691:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098246.843695:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843704:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843715:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.843729:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01452ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098246.843775:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2376:x1873908059945728:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 13662us (13830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098246.843783:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1787098246.846190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.846269:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059946112 00000100:00100000:3.0:1787098246.846467:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059946112 00000100:00100000:3.0:1787098246.846553:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:3.0:1787098246.846564:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+17:11554:x1873908059946112:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787098246.846640:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.846656:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.846669:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.846945:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.846957:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287720 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.846965:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.847011:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287720 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.847026:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287720 expref: 18 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098246.847040:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d710595f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077764224:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098246.847134:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72209df000 going to sleep for 11 seconds 00000100:00100000:0.0:1787098246.854014:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098246.854077:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d710595f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077764224:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098246.854106:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098246.854223:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059946240 00000100:00100000:1.0:1787098246.854235:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059946240 00010000:00010000:1.0:1787098246.854273:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287720 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098246.854329:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:1.0:1787098246.854339:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+19:2374:x1873908059946240:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098246.854673:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098246.854683:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287720 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.854696:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287720 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.854719:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b01452b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287720 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.854732:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:1.0:1787098246.854743:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.854752:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.854759:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.854901:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098246.855006:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+18:2374:x1873908059946240:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 668us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098246.855013:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00010000:00010000:3.0:1787098246.855062:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.855070:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787098246.855262:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787098246.855433:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787098246.855481:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787098246.855563:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d710595c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1873908077764352:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787098246.855629:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098246.855669:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203f393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098246.855923:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077764352 00000100:00100000:1.0:1787098246.855929:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077764352 00000100:00100000:1.0:1787098246.855973:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787098246.855982:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1873908077764352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787098246.856059:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1873908077764352:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098246.856066:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787098246.856175:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d710595c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1873908077764352:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787098246.856773:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787098246.856919:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d710595c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1873908077764480:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787098246.856959:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098246.857082:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72209df000 going to sleep for 11 seconds 00000100:00100000:1.0:1787098246.857248:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077764480 00000100:00100000:1.0:1787098246.857254:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077764480 00000100:00100000:1.0:1787098246.858722:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787098246.858738:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1873908077764480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787098246.859432:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5843:x1873908077764480:12345-0@lo:1000:mdt00_000.0 Request processed in 696us (2469us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787098246.859442:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787098246.859685:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d710595c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1873908077764480:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787098246.859744:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859753:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859760:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859766:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098246.859771:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859777:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859805:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7203ead500) 00010000:00010000:0.0:1787098246.859808:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098246.859813:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859819:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01452fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859852:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859858:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859863:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859877:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098246.859880:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859897:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859906:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92a00) 00010000:00010000:0.0:1787098246.859908:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098246.859911:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859924:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145232 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859954:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859968:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287704 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.859975:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.860018:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287704 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098246.860034:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287704 expref: 21 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098246.860061:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077764608:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098246.860153:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722b7a3240 going to sleep for 11 seconds 00000100:00100000:3.0:1787098246.862555:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077764608:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098246.862584:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098246.863772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.864034:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059946368 00000100:00100000:3.0:1787098246.864045:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059946368 00010000:00010000:3.0:1787098246.864083:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287704 expref: 22 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098246.864126:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:3.0:1787098246.864136:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+22:2374:x1873908059946368:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098246.864162:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098246.864171:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287704 expref: 22 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864184:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287704 expref: 22 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864207:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014524e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287704 expref: 22 pid: 5843 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864225:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92a00) 00010000:00010000:3.0:1787098246.864231:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864240:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864248:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864273:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098246.864356:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+21:2374:x1873908059946368:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 222us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098246.864364:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00010000:00010000:3.0:1787098246.864461:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864469:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864492:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864499:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864506:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864513:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098246.864518:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864525:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864534:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92a00) 00010000:00010000:3.0:1787098246.864537:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098246.864541:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864547:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145304 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864558:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864563:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864569:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864580:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098246.864583:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864589:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864597:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92a00) 00010000:00010000:3.0:1787098246.864600:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787098246.864603:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.864608:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b01452f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098246.865125:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+20:11554:x1873908059946112:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 18562us (18943us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787098246.865134:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 186 00000020:00080000:3.0:1787098246.865138:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787098246.865207:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787098246.865212:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787098246.866638:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787098246.866652:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787098246.867565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098246.867648:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059946624 00000100:00100000:3.0:1787098246.867658:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059946624 00000100:00100000:3.0:1787098246.867738:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:3.0:1787098246.867748:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+20:11554:x1873908059946624:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787098246.868519:0:5846:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787098246.868629:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787098246.868679:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.868696:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.868715:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.868724:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.868731:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.868737:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098246.868767:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787098246.868869:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+22:11554:x1873908059946624:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1119us (1307us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787098246.868879:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000020:00080000:3.0:1787098246.868897:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787098246.868978:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098246.868985:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.868999:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098246.869003:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.869009:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.869022:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d7207e92000) 00010000:00010000:1.0:1787098246.869026:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787098246.869030:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.869036:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b014530b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098246.869054:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098246.869056:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098246.869058:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098247.567524:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098248.591383:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787098248.613276:0:12578:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787098248.613517:0:12578:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787098248.613568:0:12578:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787098248.613574:0:12578:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787098248.745121:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098248.745219:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059946880 00000100:00100000:1.0:1787098248.745232:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059946880 00000100:00100000:1.0:1787098248.745341:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:1.0:1787098248.745354:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+22:11573:x1873908059946880:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1787098248.745390:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098248.745415:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528773c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787098248.745887:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787098248.745994:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145319 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.746023:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145319 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.746036:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145319 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098248.746050:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787098248.746252:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528773c expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.746271:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145319 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528773c expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.746669:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:1.0:1787098248.746673:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787098248.746678:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412600, rc 0) 00000100:00100000:1.0:1787098248.746763:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+24:11573:x1873908059946880:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1412us (1649us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787098248.746772:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:0.0:1787098248.750967:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098248.751174:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059947008 00000100:00100000:1.0:1787098248.751187:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059947008 00000100:00100000:1.0:1787098248.751254:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:1.0:1787098248.751265:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+24:11573:x1873908059947008:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:1.0:1787098248.751376:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751397:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751419:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751437:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751444:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751452:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751782:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751791:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751798:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787098248.751841:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751866:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751872:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751878:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751894:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098248.751899:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751907:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751922:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:1.0:1787098248.751925:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098248.751930:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751936:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145327 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751949:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751954:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751960:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751965:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098248.751968:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751974:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.751992:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7208d7f200) 00010000:00010000:1.0:1787098248.751995:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098248.751998:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.752003:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014532e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.752019:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.752024:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.752030:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.752035:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098248.752037:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.752043:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.752050:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208d7fe00) 00010000:00010000:1.0:1787098248.752052:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098248.752055:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.752060:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145335 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098248.752153:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+24:11573:x1873908059947008:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 888us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098248.752163:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:3.0:1787098248.805460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098248.805788:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059947264 00000100:00100000:0.0:1787098248.805798:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059947264 00000100:00100000:0.0:1787098248.805943:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:0.0:1787098248.805954:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+24:11577:x1873908059947264:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098248.805984:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098248.806008:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014533c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287743 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806083:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806097:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806108:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806121:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806127:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806142:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806517:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806527:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806534:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098248.806545:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787098248.806645:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806654:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806660:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806667:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098248.806671:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806679:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806691:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:0.0:1787098248.806694:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098248.806705:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806712:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806725:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806731:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806737:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806743:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098248.806747:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806754:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806763:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7208701000) 00010000:00010000:0.0:1787098248.806765:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098248.806768:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806773:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b014534a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806812:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014533c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287743 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.806838:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287743 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.807823:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:0.0:1787098248.807831:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098248.807834:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:0.0:1787098248.807948:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+26:11577:x1873908059947264:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1992us (2493us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787098248.807957:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:1.0:1787098248.812910:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098248.813013:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059947392 00000100:00100000:0.0:1787098248.813023:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059947392 00000100:00100000:0.0:1787098248.813134:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:0.0:1787098248.813144:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+26:11577:x1873908059947392:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1787098248.813217:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.813234:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.813246:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.813274:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.813532:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.813550:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.813557:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098248.813561:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.813569:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.813582:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:0.0:1787098248.813585:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787098248.813589:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.813595:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b014535f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098248.813718:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+26:11577:x1873908059947392:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 575us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098248.813727:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:3.0:1787098248.816906:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098248.820460:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059947648 00000100:00100000:0.0:1787098248.820477:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059947648 00000100:00100000:0.0:1787098248.820615:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1787098248.820627:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+26:11577:x1873908059947648:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1787098248.820894:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+27:11577:x1873908059947648:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 268us (3997us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787098248.820903:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1787098248.848027:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077764992:0@lo:400:kworker.0 00000100:00100000:0.0:1787098248.848124:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077764864:0@lo:400:kworker.0 00000100:00100000:0.0:1787098248.848206:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098248.848264:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077765376:0@lo:400:kworker.0 00000100:00100000:0.0:1787098248.848312:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098248.848546:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098248.848818:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077764736:0@lo:400:kworker.0 00000100:00100000:2.0:1787098248.848869:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098248.848905:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077765248:0@lo:400:kworker.0 00000100:00100000:2.0:1787098248.848930:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098248.848950:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787098248.848957:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077765120:0@lo:400:kworker.0 00000100:00100000:2.0:1787098248.848979:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098248.849020:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077764864 00000100:00100000:2.0:1787098248.849042:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077764864 00000100:00100000:2.0:1787098248.849089:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077764992 00000100:00100000:2.0:1787098248.849092:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077764992 00000100:00100000:2.0:1787098248.849113:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077765248 00000100:00100000:2.0:1787098248.849116:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077765248 00000100:00100000:2.0:1787098248.849132:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787098248.849263:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077764864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098248.849342:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077764864:12345-0@lo:400:kworker.0 Request processed in 201us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098248.849350:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787098248.849367:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787098248.849375:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077764992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098248.849589:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077765376 00000100:00100000:0.0:1787098248.849593:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077765376 00000100:00100000:0.0:1787098248.849623:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077765120 00000100:00100000:0.0:1787098248.849627:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077765120 00000100:00100000:0.0:1787098248.849788:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787098248.849797:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1873908077765376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098248.849843:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1873908077765376:12345-0@lo:400:kworker.0 Request processed in 48us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098248.849864:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787098248.849879:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787098248.849885:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1873908077765120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098248.849925:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1873908077765120:12345-0@lo:400:kworker.0 Request processed in 40us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098248.849931:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787098248.850313:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077764992:12345-0@lo:400:kworker.0 Request processed in 938us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098248.850321:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787098248.850336:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787098248.850343:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077765248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098248.850372:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077765248:12345-0@lo:400:kworker.0 Request processed in 29us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098248.850377:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787098248.850518:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b952300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077765120:0@lo:400:kworker.0 00000100:00100000:0.0:1787098248.850530:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077765248:0@lo:400:kworker.0 00000100:00080000:3.0:1787098248.850716:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787098248.850721:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787098248.850723:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098248.850976:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077764736 00000100:00100000:1.0:1787098248.850983:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077764736 00000100:00100000:1.0:1787098248.851037:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787098248.851045:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077764736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098248.851100:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3312:x1873908077764736:12345-0@lo:400:kworker.0 Request processed in 57us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098248.851107:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787098248.851803:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077764992:0@lo:400:kworker.0 00000100:00100000:2.0:1787098248.851857:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077764864:0@lo:400:kworker.0 00000100:00100000:2.0:1787098248.851872:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b953800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077765376:0@lo:400:kworker.0 00000100:00100000:0.0:1787098248.852025:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077764736:0@lo:400:kworker.0 00000100:00100000:3.0:1787098248.869531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098248.869727:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059947904 00000100:00100000:0.0:1787098248.869738:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059947904 00000100:00100000:0.0:1787098248.869802:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:0.0:1787098248.869813:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+27:11102:x1873908059947904:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098248.869860:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098248.869884:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145366 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528774a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.869990:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.870769:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287743 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.870779:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.870948:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287743 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098248.870966:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287743 expref: 28 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098248.870985:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b951180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077765504:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098248.871133:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098248.877643:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098248.878237:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059948032 00000100:00100000:2.0:1787098248.878248:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059948032 00010000:00010000:2.0:1787098248.878328:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287743 expref: 29 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098248.878378:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:2.0:1787098248.878480:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+29:2374:x1873908059948032:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098248.878497:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098248.878505:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287743 expref: 29 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098248.878520:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287743 expref: 29 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098248.878544:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:2.0:1787098248.878549:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098248.878560:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098248.878568:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098248.878588:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098248.878853:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+29:2374:x1873908059948032:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 367us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098248.878863:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00010000:00010000:3.0:1787098248.879255:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145351 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287743 expref: 28 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098248.879320:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b951180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077765504:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098248.879343:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.879353:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.879359:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098248.879379:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787098248.879571:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b0145366 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528774a expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.879588:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528774a expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.879596:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:3.0:1787098248.879599:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787098248.879603:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695800, rc 0) 00000100:00100000:3.0:1787098248.879641:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+28:11102:x1873908059947904:12345-192.168.204.51@tcp:101:bash.0 Request processed in 9831us (10122us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787098248.880228:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:3.0:1787098248.883237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098248.884136:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059948288 00000100:00100000:2.0:1787098248.884217:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059948288 00000100:00100000:2.0:1787098248.886347:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00100000:2.0:1787098248.886372:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+28:11102:x1873908059948288:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:2.0:1787098248.886886:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098248.886904:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098248.886916:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098248.886970:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787098248.886997:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f11209f2 reply state 00000000facc937e transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098248.887006:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787098248.887242:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787098248.887564:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+32:11102:x1873908059948288:12345-192.168.204.51@tcp:36:bash.0 Request processed in 1200us (4334us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787098248.887573:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 192 00000020:00080000:2.0:1787098248.887578:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787098248.893957:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.893999:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.894007:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.894014:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098248.894019:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.894027:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.894219:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:3.0:1787098248.894224:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098248.894231:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.894237:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622800/0xb1d871f9b014537b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098248.896730:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098248.896835:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059948416 00000100:00100000:0.0:1787098248.896857:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059948416 00000100:00100000:0.0:1787098248.896927:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:0.0:1787098248.896938:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+31:11102:x1873908059948416:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098248.896963:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098248.896983:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287751 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.897056:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287751 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.897074:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287751 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098248.897094:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:0.0:1787098248.897110:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098248.897114:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695000, rc 0) 00000100:00100000:0.0:1787098248.897186:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+32:11102:x1873908059948416:12345-192.168.204.51@tcp:101:bash.0 Request processed in 249us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098248.897193:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:1.0:1787098248.908048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098248.908258:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059948544 00000100:00100000:3.0:1787098248.908270:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059948544 00000100:00100000:3.0:1787098248.908383:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:3.0:1787098248.908394:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:11102:x1873908059948544:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1787098248.908414:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098248.908435:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287758 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787098248.908489:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a84f485, atime: 0x6a84f483, ctime: 0x6a84f485, blocks: 0xb 00010000:00010000:3.0:1787098248.908513:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1787098248.908519:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098248.908527:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287758 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.908546:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287758 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787098248.908552:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787098248.908561:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030600, rc 0) 00000100:00100000:3.0:1787098248.908927:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:11102:x1873908059948544:12345-192.168.204.51@tcp:101:bash.0 Request processed in 533us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098248.908935:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:1.0:1787098248.911705:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098248.912308:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059948672 00000100:00100000:2.0:1787098248.912320:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059948672 00002000:00010000:2.0:1787098248.912370:0:6708:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787098248.912375:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b950700 with x1873908059948672 ext(0->18446744073709551615) 00002000:00010000:2.0:1787098248.912398:0:6708:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d723b950700. 00000100:00100000:2.0:1787098248.912434:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1787098248.912443:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2376:x1873908059948672:12345-192.168.204.51@tcp:10:bash.0 00002000:00010000:2.0:1787098248.913341:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787098248.913347:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787098245 -> 1787098248 00002000:00010000:2.0:1787098248.913350:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787098243 -> 1787098243 00002000:00010000:2.0:1787098248.913364:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787098245 -> 1787098248 00002000:00010000:2.0:1787098248.913366:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787098248.913446:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2376:x1873908059948672:12345-192.168.204.51@tcp:10:bash.0 Request processed in 1001us (1748us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787098248.913456:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00002000:00010000:2.0:1787098248.913464:0:6708:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787098248.913467:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b950700 with x1873908059948672 ext(0->18446744073709551615) 00002000:00010000:2.0:1787098248.913472:0:6708:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d723b950700. 00000100:00100000:0.0:1787098248.971137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098248.971496:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059948800 00000100:00100000:2.0:1787098248.971508:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059948800 00000100:00100000:3.0:1787098248.972361:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:3.0:1787098248.972375:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+32:11591:x1873908059948800:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:3.0:1787098248.972455:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.972892:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.972906:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.972926:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.972947:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.972954:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.973661:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.973673:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.973750:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098248.973794:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.973806:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.973813:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.973819:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.973825:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098248.973829:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.973836:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974626:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098248.974629:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098248.974635:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974641:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145390 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974659:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974666:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974672:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974678:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098248.974681:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974687:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974694:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098248.974696:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098248.974699:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974704:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b0145397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974738:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974744:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974750:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974755:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098248.974758:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974763:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974771:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:3.0:1787098248.974773:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098248.974776:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098248.974781:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014539e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098248.975090:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+32:11591:x1873908059948800:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 2713us (3959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098248.975102:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:1.0:1787098249.010944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.011135:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059949056 00000100:00100000:0.0:1787098249.011146:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059949056 00000100:00100000:0.0:1787098249.011212:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:0.0:1787098249.011222:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+32:11594:x1873908059949056:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098249.011241:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098249.011262:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01453a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528775f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.012744:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.012765:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.012777:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.012793:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.012801:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.012807:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013160:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01453ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013170:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01453ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013178:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01453ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098249.013188:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787098249.013328:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013336:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013343:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013349:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098249.013353:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013359:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013373:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:0.0:1787098249.013376:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098249.013381:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013397:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b01453ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013412:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013417:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013423:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013427:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098249.013431:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013436:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013444:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7208701000) 00010000:00010000:0.0:1787098249.013446:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098249.013449:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.013455:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01453b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.014574:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01453a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528775f expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.014600:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01453ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528775f expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.014621:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:0.0:1787098249.014624:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787098249.014626:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:0.0:1787098249.014704:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+34:11594:x1873908059949056:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 3482us (3770us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787098249.014712:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:1.0:1787098249.022165:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.022368:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059949184 00000100:00100000:2.0:1787098249.022382:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059949184 00000100:00100000:2.0:1787098249.022510:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:2.0:1787098249.022522:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+34:11594:x1873908059949184:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1787098249.022607:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.022624:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528774a expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.022634:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.022672:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528774a expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.022687:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528774a expref: 34 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.022725:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077765632:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098249.022831:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7105a86180 going to sleep for 11 seconds 00000100:00100000:1.0:1787098249.027350:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.027524:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077765632:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098249.027556:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098249.027686:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059949440 00000100:00100000:3.0:1787098249.027694:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059949440 00000100:00100000:3.0:1787098249.027831:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:3.0:1787098249.027871:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+35:5610:x1873908059949440:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787098249.028890:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+36:5610:x1873908059949440:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 1017us (1546us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787098249.028902:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:1.0:1787098249.032765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.032915:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059949568 00000100:00100000:2.0:1787098249.032926:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059949568 00010000:00010000:2.0:1787098249.032967:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528774a expref: 36 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.033008:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:2.0:1787098249.033017:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7208e30850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+36:2373:x1873908059949568:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098249.033031:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098249.033037:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528774a expref: 36 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.033050:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528774a expref: 36 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.033070:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b014536d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528774a expref: 36 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.033106:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:2.0:1787098249.033112:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.033122:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.033129:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.033976:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098249.034037:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7208e30850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+35:2373:x1873908059949568:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1018us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.034048:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00010000:00010000:3.0:1787098249.034883:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.034896:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.034931:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.034938:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.034945:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.034951:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.035078:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.035088:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.035101:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:3.0:1787098249.035104:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098249.035108:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.035115:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622a00/0xb1d871f9b01453c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098249.035177:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+34:11594:x1873908059949184:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 12656us (13019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098249.035197:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:1.0:1787098249.045910:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.046002:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059949824 00000100:00100000:0.0:1787098249.046012:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059949824 00000100:00100000:0.0:1787098249.046082:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1787098249.046092:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+34:11594:x1873908059949824:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1787098249.046390:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+35:11594:x1873908059949824:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 300us (491us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1787098249.046398:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:2.0:1787098249.145960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098249.146416:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059950080 00000100:00100000:1.0:1787098249.146426:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059950080 00000100:00100000:1.0:1787098249.146492:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:1.0:1787098249.146502:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+35:11605:x1873908059950080:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1787098249.146524:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098249.146546:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01453cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287766 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.146614:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.146628:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.146639:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.146653:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.146659:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.146665:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.147611:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b01453e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.147630:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b01453e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.147639:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b01453e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098249.147650:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787098249.148523:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148534:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148541:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148548:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098249.148552:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148559:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148572:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:1.0:1787098249.148575:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098249.148580:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148586:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b01453d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148600:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148617:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148623:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148628:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098249.148631:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148638:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148646:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7208d7fe00) 00010000:00010000:1.0:1787098249.148649:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098249.148652:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.148657:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b01453dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.149217:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01453cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287766 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.149240:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b01453e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287766 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.149249:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:1.0:1787098249.149252:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787098249.149262:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412000, rc 0) 00000100:00100000:1.0:1787098249.149573:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+37:11605:x1873908059950080:12345-192.168.204.51@tcp:101:cat.0 Request processed in 3070us (3620us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787098249.149583:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:3.0:1787098249.157804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.158886:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059950336 00000100:00100000:0.0:1787098249.158899:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059950336 00000100:00100000:0.0:1787098249.158966:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:0.0:1787098249.158978:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+37:11605:x1873908059950336:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1787098249.159235:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+38:11605:x1873908059950336:12345-192.168.204.51@tcp:35:cat.0 Request processed in 259us (1440us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787098249.159243:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:0.0:1787098249.190826:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.191188:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059950592 00000100:00100000:3.0:1787098249.191199:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059950592 00000100:00100000:3.0:1787098249.191364:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:3.0:1787098249.191376:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+38:11606:x1873908059950592:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:3.0:1787098249.191455:0:6853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787098249.191484:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b01453e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287766 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.191524:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01453ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528775f expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.191539:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287751 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.191551:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7208701c00) 00010000:00010000:3.0:1787098249.191562:0:6853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098249.191585:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.191598:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.191607:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.191621:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.191644:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.191652:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.192319:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.192330:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.192337:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787098249.193456:0:6853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1787098249.193471:0:6853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347449190532ns, next at 348449187361ns, rc = 0 00010000:00010000:3.0:1787098249.193615:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193628:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193637:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193645:0:6853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193651:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193668:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193691:0:6853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787098249.193714:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193720:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193726:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193732:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.193736:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193744:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193756:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:3.0:1787098249.193759:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787098249.193763:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193768:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030c00/0xb1d871f9b0145400 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193788:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.193791:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098249.193793:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.193798:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.193804:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098249.193805:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.193808:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193811:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.193814:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.193815:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193820:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.193824:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:1.0:1787098249.193826:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787098249.193827:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098249.193829:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098249.193829:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193831:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.193835:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145407 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.193850:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b01453f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098249.193860:0:6853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000778dd82a reply state 00000000e227fd62 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.193863:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098249.193864:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098249.193866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098249.193869:0:6853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787098249.193964:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+37:11606:x1873908059950592:12345-192.168.204.51@tcp:36:rm.0 Request processed in 2585us (3143us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787098249.193973:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 198 00010000:00010000:3.0:1787098249.196275:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.196851:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.196877:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.196883:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.196887:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.196894:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.196910:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098249.196913:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098249.196917:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.197112:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01453f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098249.247734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.247884:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059950848 00000100:00100000:3.0:1787098249.247895:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059950848 00000100:00100000:3.0:1787098249.248092:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:3.0:1787098249.248104:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+36:11612:x1873908059950848:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1787098249.248129:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098249.248161:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014540e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528776d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.248341:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.248377:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.248388:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.248405:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.248412:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.248419:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787098249.249007:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787098249.249187:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249199:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249208:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249247:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249254:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249260:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249274:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.249321:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249330:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249344:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098249.249347:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098249.249352:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249358:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145415 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098249.249376:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040bf892e reply state 00000000e9fbedc3 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098249.249386:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787098249.249431:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b014540e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528776d expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249447:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528776d expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.249455:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92c00) 00010000:00010000:3.0:1787098249.249457:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098249.249459:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6e00, rc 0) 00000100:00100000:3.0:1787098249.249551:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+39:11612:x1873908059950848:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1449us (1826us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787098249.249566:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:2.0:1787098249.253901:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.253937:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059950976 00000100:00100000:2.0:1787098249.253965:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059950976 00000100:00100000:2.0:1787098249.254027:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:2.0:1787098249.254038:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2374:x1873908059950976:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1787098249.254055:0:6860:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098249.254077:0:6860:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287774 expref: -99 pid: 6860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098249.254104:0:6860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098249.254122:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1787098249.254126:0:6860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098249.254158:0:6860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287774 expref: 6 pid: 6860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.254178:0:6860:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287774 expref: 6 pid: 6860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.254191:0:6860:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623e00, rc 0) 00000100:00100000:2.0:1787098249.254244:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059950976:12345-192.168.204.51@tcp:101:bash.0 Request processed in 208us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.254251:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00080000:2.0:1787098249.254276:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787098249.254858:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.254870:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.254877:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.254883:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.254887:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.254894:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.254908:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098249.254911:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098249.254916:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.254922:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014541c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.259762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.259877:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059951104 00000100:00100000:0.0:1787098249.259887:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059951104 00000100:00100000:0.0:1787098249.259966:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1787098249.259975:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:11612:x1873908059951104:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098249.259995:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098249.260013:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528777b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.260046:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287774 expref: 7 pid: 6860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.260054:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098249.260058:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098249.260063:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.260094:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287774 expref: 7 pid: 6860 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.260106:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287774 expref: 7 pid: 6860 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098249.260120:0:6703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6703:1873908077765760:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098249.260228:0:6703:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72087ca180 going to sleep for 11 seconds 00000100:00100000:2.0:1787098249.267980:0:6703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6703:1873908077765760:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098249.268016:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.268037:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695200, rc 0) 00000100:00100000:2.0:1787098249.268102:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:11612:x1873908059951104:12345-192.168.204.51@tcp:101:bash.0 Request processed in 8128us (8352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.268111:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1787098249.271008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.271398:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059951232 00000100:00100000:2.0:1787098249.271409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059951232 00010000:00010000:2.0:1787098249.271457:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287774 expref: 7 pid: 6860 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.271501:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:2.0:1787098249.271525:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059951232:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098249.271541:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098249.271563:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287774 expref: 7 pid: 6860 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.271587:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287774 expref: 7 pid: 6860 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.271610:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b9a8acd/0xb1d871f9b0145431 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287774 expref: 7 pid: 6860 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.271628:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098249.271632:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098249.271641:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.271651:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.271690:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.272090:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1873908077765888:192.168.204.51@tcp:105: 00000100:00100000:2.0:1787098249.272425:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7105a866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098249.277741:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1873908077765888:192.168.204.51@tcp:105: 00010000:00010000:3.0:1787098249.277767:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098249.277821:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b951c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2373:x1873908059951232:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 6297us (6822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098249.277832:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:0.0:1787098249.286211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.286323:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059951488 00000100:00100000:2.0:1787098249.286348:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059951488 00000100:00100000:2.0:1787098249.286416:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:2.0:1787098249.286427:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+38:11612:x1873908059951488:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1787098249.286830:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+39:11612:x1873908059951488:12345-192.168.204.51@tcp:35:bash.0 Request processed in 404us (628us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787098249.286848:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:2.0:1787098249.361241:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077766016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098249.361360:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098249.361518:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077766016 00000100:00100000:1.0:1787098249.361525:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077766016 00000100:00100000:1.0:1787098249.361571:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787098249.361581:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1873908077766016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098249.361630:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098249.361687:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1873908077766016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098249.361695:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787098249.361774:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077766016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098249.508534:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.510065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059951616 00000100:00100000:3.0:1787098249.510079:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059951616 00000100:00100000:3.0:1787098249.510214:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 200 00000100:00100000:3.0:1787098249.510226:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+39:11628:x1873908059951616:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098249.510251:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098249.510272:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014543f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287782 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.510391:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145446 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.510405:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.510417:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098249.510479:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787098249.510483:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098249.510503:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.510528:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014543f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287782 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.510548:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287782 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.510727:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098249.510731:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098249.510741:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7c00, rc 0) 00000100:00100000:3.0:1787098249.510846:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+40:11628:x1873908059951616:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 622us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098249.510853:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 200 00000100:00100000:3.0:1787098249.514552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098249.514716:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059951872 00000100:00100000:1.0:1787098249.514727:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059951872 00000100:00100000:1.0:1787098249.514887:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:1.0:1787098249.514899:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+40:11628:x1873908059951872:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1787098249.514922:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098249.515047:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b014544d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287789 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.515166:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.515181:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.515193:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098249.515204:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787098249.515547:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413800/0xb1d871f9b014544d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287789 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.515566:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287789 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.515574:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92c00) 00010000:00010000:1.0:1787098249.515590:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787098249.515594:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413000, rc 0) 00000100:00100000:1.0:1787098249.515724:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+42:11628:x1873908059951872:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 826us (1181us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787098249.515733:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:0.0:1787098249.518697:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.518849:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059952000 00000100:00100000:2.0:1787098249.518859:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059952000 00000100:00100000:2.0:1787098249.518923:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1787098249.518933:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+42:2373:x1873908059952000:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098249.518963:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098249.518987:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145454 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287789 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.519004:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92c00) 00010000:00010000:2.0:1787098249.519008:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098249.519065:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+41:2373:x1873908059952000:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 134us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.519073:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1787098249.520645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.520723:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059952256 00000100:00100000:0.0:1787098249.520731:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059952256 00000100:00100000:0.0:1787098249.520802:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 202 00000100:00100000:0.0:1787098249.520811:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+41:11628:x1873908059952256:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098249.520848:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098249.520872:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145462 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287790 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.520999:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145469 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.521014:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145469 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.521024:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145469 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098249.521037:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787098249.521179:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145462 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287790 expref: 44 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.521199:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145469 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287790 expref: 43 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.521209:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92c00) 00010000:00010000:0.0:1787098249.521212:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787098249.521215:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694c00, rc 0) 00000100:00100000:0.0:1787098249.521424:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+43:11628:x1873908059952256:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 613us (787us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787098249.521431:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 202 00000100:00100000:3.0:1787098249.531437:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098249.533731:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059952384 00000100:00100000:1.0:1787098249.533747:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059952384 00000100:00100000:1.0:1787098249.533896:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:1.0:1787098249.533909:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+6:2374:x1873908059952384:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:1.0:1787098249.533966:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.533989:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.533999:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098249.534004:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787098249.534009:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.534046:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.534060:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 6 pid: 6703 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098249.534076:0:6702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b950a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1873908077766144:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098249.534216:0:6702:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73000 going to sleep for 11 seconds 00000100:00100000:1.0:1787098249.537683:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.537856:0:6702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b950a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6702:1873908077766144:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098249.537883:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098249.537972:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059952512 00000100:00100000:0.0:1787098249.537990:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059952512 00002000:00100000:0.0:1787098249.538034:0:6706:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d723b950e00 x1873908059952512/t0(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:425/0 lens 504/0 e 0 to 0 dl 1787098260 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787098249.538044:0:6706:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b950e00 with x1873908059952512 ext(0->8) 00010000:00010000:0.0:1787098249.538051:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 7 pid: 6703 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.538065:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 7 pid: 6703 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098249.538072:0:6706:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d723b950e00 00000100:00100000:0.0:1787098249.538105:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1787098249.538115:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059952512:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:0.0:1787098249.538651:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2373:x1873908059952512:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 535us (975us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787098249.538660:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00002000:00100000:0.0:1787098249.538668:0:6706:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d723b950e00 x1873908059952512/t4294967308(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:425/0 lens 504/448 e 0 to 0 dl 1787098260 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787098249.538676:0:6706:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b950e00 with x1873908059952512 ext(0->8) 00010000:00010000:0.0:1787098249.538682:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 9 pid: 6703 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.538694:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 9 pid: 6703 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098249.538701:0:6706:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8d723b950e00 00000100:00100000:3.0:1787098249.542426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.542530:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059952640 00000100:00100000:2.0:1787098249.542541:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059952640 00010000:00010000:2.0:1787098249.542590:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 9 pid: 6703 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.542638:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:2.0:1787098249.542656:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2374:x1873908059952640:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098249.542671:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787098249.542690:0:11178:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787098249.542693:0:11178:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787098249 00002000:00010000:2.0:1787098249.542695:0:11178:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787098249 00002000:00010000:2.0:1787098249.542697:0:11178:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787098249 00010000:00010000:2.0:1787098249.542703:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 9 pid: 6703 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.542716:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 9 pid: 6703 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.542738:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000255501cb/0xb1d871f9b0145438 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528777b expref: 9 pid: 6703 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.542755:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787098249.542760:0:11178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787098249.542764:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.542774:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.542862:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098249.542915:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2374:x1873908059952640:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 261us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.542923:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00010000:00010000:3.0:1787098249.544783:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.544802:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.544852:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.544861:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.544870:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.544877:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098249.544900:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.544910:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.544931:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.545003:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000046457e8/0xb1d871f9b0145477 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098249.545225:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059952384:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 11314us (13793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098249.545235:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1787098249.547960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.548144:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059952896 00000100:00100000:2.0:1787098249.548155:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059952896 00000100:00100000:2.0:1787098249.548319:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1787098249.548332:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+43:11628:x1873908059952896:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:2.0:1787098249.548397:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145469 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287790 expref: 43 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098249.548647:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787098249.548692:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787098249.549018:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787098249.549083:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.549099:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528776d expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.549109:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.549145:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528776d expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.549158:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528776d expref: 47 pid: 5843 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.549187:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1873908077766272:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098249.549269:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7105a86240 going to sleep for 11 seconds 00000100:00100000:2.0:1787098249.552145:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1873908077766272:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098249.552182:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098249.552255:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.552440:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059953024 00000100:00100000:2.0:1787098249.552448:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059953024 00010000:00010000:2.0:1787098249.552483:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528776d expref: 48 pid: 5843 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.552568:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:2.0:1787098249.552579:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+48:2373:x1873908059953024:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098249.552594:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098249.552601:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528776d expref: 48 pid: 5843 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.552614:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528776d expref: 48 pid: 5843 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.552634:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528776d expref: 48 pid: 5843 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.552651:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92c00) 00010000:00010000:2.0:1787098249.552657:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.552681:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.552688:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.552765:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098249.552824:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+47:2373:x1873908059953024:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 243us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.552841:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00010000:00010000:0.0:1787098249.552913:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.552921:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787098249.553044:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787098249.553324:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787098249.553439:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077766400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787098249.553489:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098249.553529:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077766400 00000100:00100000:0.0:1787098249.553535:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077766400 00000100:00100000:0.0:1787098249.553564:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787098249.553572:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1873908077766400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787098249.553633:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1873908077766400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098249.553639:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787098249.553658:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a683480 going to sleep for 11 seconds 00000100:00100000:0.0:1787098249.553679:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077766400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787098249.554110:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787098249.554165:0:5847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077766528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787098249.554207:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098249.554236:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077766528 00000100:00100000:0.0:1787098249.554240:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077766528 00000100:00100000:0.0:1787098249.554261:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787098249.554274:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1873908077766528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787098249.554436:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5847:x1873908077766528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (229us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787098249.554459:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787098249.554480:0:5847:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787098249.554500:0:5847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1873908077766528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787098249.554536:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787098249.554568:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.554577:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.554584:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.554590:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098249.554594:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.554602:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.554617:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92c00) 00010000:00010000:0.0:1787098249.554620:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787098249.554624:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.554630:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b014547e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787098249.554781:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787098249.554890:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787098249.554907:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347810626564ns, next at 348810624684ns, rc = 0 00000001:00080000:0.0:1787098249.554914:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787098249.554946:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92c00) 00010000:00010000:0.0:1787098249.554949:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787098249.554955:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145469 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287790 expref: 51 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098249.555053:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+50:11628:x1873908059952896:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 6724us (7113us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787098249.555061:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000020:00080000:0.0:1787098249.555065:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787098249.558842:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.558922:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059953152 00000100:00100000:3.0:1787098249.558934:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059953152 00000100:00100000:3.0:1787098249.559008:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:3.0:1787098249.559018:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+50:11628:x1873908059953152:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098249.559044:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098249.559068:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287797 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.559891:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287797 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.559928:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287797 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.559951:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098249.559955:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787098249.559959:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7000, rc 0) 00000100:00100000:3.0:1787098249.560021:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+51:11628:x1873908059953152:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1004us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098249.560029:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:3.0:1787098249.568934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098249.569320:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059953408 00000100:00100000:1.0:1787098249.569331:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059953408 00000100:00100000:1.0:1787098249.569383:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1787098249.569394:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+51:11628:x1873908059953408:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1787098249.571452:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+52:11628:x1873908059953408:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 2049us (2519us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787098249.571465:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00010000:00010000:1.0:1787098249.615426:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098249.662080:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.662172:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059953536 00000100:00100000:3.0:1787098249.662182:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059953536 00000100:00100000:3.0:1787098249.662247:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:3.0:1787098249.662256:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+52:11638:x1873908059953536:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:3.0:1787098249.662366:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662383:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662394:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662410:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662417:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662441:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662537:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662545:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662551:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098249.662596:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662609:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662616:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662623:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662630:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.662635:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662643:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662669:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098249.662678:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098249.662683:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662690:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b014548c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662706:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662711:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662717:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662721:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.662724:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662730:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662737:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92300) 00010000:00010000:3.0:1787098249.662740:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098249.662742:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662747:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662762:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662773:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662779:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662784:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.662787:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662792:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662800:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098249.662802:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098249.662804:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.662809:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b014549a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098249.662907:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+52:11638:x1873908059953536:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 651us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098249.662915:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:2.0:1787098249.707771:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.707916:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059953792 00000100:00100000:3.0:1787098249.707928:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059953792 00000100:00100000:3.0:1787098249.708069:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:3.0:1787098249.708082:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+52:11641:x1873908059953792:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098249.708108:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098249.708147:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b01454a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528779e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708222:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708236:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708248:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708262:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708269:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708275:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708437:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708460:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708468:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098249.708486:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787098249.708603:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708623:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708630:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708637:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.708641:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708648:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708660:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:3.0:1787098249.708663:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098249.708668:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708674:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b01454a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708691:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708697:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708703:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708707:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.708716:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708721:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708729:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7207e92300) 00010000:00010000:3.0:1787098249.708731:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098249.708734:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708739:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b01454af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708777:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b01454a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528779e expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708791:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528779e expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.708799:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098249.708801:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787098249.708803:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200031200, rc 0) 00000100:00100000:3.0:1787098249.709139:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+54:11641:x1873908059953792:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1058us (1377us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787098249.709147:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:1.0:1787098249.712233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.712383:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059953920 00000100:00100000:2.0:1787098249.712393:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059953920 00000100:00100000:2.0:1787098249.712455:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:2.0:1787098249.712465:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+54:11641:x1873908059953920:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1787098249.712766:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.712786:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.712798:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.712839:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.712847:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.712868:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.712875:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098249.712879:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.712888:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.712902:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098249.712905:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098249.712910:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.712917:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.713175:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+54:11641:x1873908059953920:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 708us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.713183:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:0.0:1787098249.718615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.722407:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059954176 00000100:00100000:2.0:1787098249.722423:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059954176 00000100:00100000:2.0:1787098249.722494:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1787098249.722505:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+54:11641:x1873908059954176:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1787098249.722757:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+55:11641:x1873908059954176:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 254us (4151us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787098249.722765:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:0.0:1787098249.792388:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098249.795495:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059954432 00000100:00100000:1.0:1787098249.795513:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059954432 00000100:00100000:1.0:1787098249.795591:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:1.0:1787098249.795602:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+55:11651:x1873908059954432:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1787098249.795632:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098249.795636:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787098249.795665:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145446 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287782 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.795688:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:1.0:1787098249.795694:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787098249.795707:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413c00/0xb1d871f9b01454cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877a5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.795800:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.795842:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528779e expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.795852:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.795885:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528779e expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.795899:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528779e expref: 55 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098249.795912:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b953480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077766656:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098249.796151:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73780 going to sleep for 11 seconds 00000100:00100000:1.0:1787098249.807878:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b953480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077766656:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098249.807910:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098249.811844:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.812133:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059954560 00000100:00100000:2.0:1787098249.812143:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059954560 00010000:00010000:2.0:1787098249.812186:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528779e expref: 56 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.812340:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:2.0:1787098249.812354:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+56:2373:x1873908059954560:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098249.812369:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098249.812377:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528779e expref: 56 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.812391:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528779e expref: 56 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.812416:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200031200/0xb1d871f9b01454b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528779e expref: 56 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.812432:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098249.812438:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.812447:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.812454:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.812486:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098249.812580:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+55:2373:x1873908059954560:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 229us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.812600:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00010000:00010000:3.0:1787098249.815100:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.815118:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098249.815159:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787098249.815535:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413c00/0xb1d871f9b01454cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877a5 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.815683:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877a5 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.815693:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098249.815696:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787098249.815700:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412c00, rc 0) 00000100:00100000:3.0:1787098249.815777:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+55:11651:x1873908059954432:12345-192.168.204.51@tcp:101:bash.0 Request processed in 20176us (23400us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787098249.815786:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:0.0:1787098249.819570:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.819727:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059954816 00000100:00100000:3.0:1787098249.819737:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059954816 00000100:00100000:3.0:1787098249.819799:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:3.0:1787098249.819809:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+55:11651:x1873908059954816:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:2.0:1787098249.821965:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.821988:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.822011:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098249.822096:0:6853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787098249.822136:0:6853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060ed9418 reply state 00000000b31c549f transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.822145:0:6853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787098249.822434:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11651:x1873908059954816:12345-192.168.204.51@tcp:36:bash.0 Request processed in 2622us (2869us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787098249.822444:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 208 00000020:00080000:2.0:1787098249.822450:0:6853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787098249.826997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:3.0:1787098249.827383:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.827398:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.827405:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.827412:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098249.827434:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.827442:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.827459:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098249.827463:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098249.827468:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.827474:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b01454e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098249.827858:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059954944 00000100:00100000:1.0:1787098249.827868:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059954944 00000100:00100000:1.0:1787098249.827923:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:1.0:1787098249.827933:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11651:x1873908059954944:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1787098249.827957:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098249.827974:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b01454e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877ac expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.828846:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.828872:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877a5 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.828880:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.828913:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877a5 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.828927:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877a5 expref: 58 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098249.829019:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b953480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077766784:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098249.829186:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73780 going to sleep for 11 seconds 00000100:00100000:0.0:1787098249.834190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.834545:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059955072 00000100:00100000:3.0:1787098249.834564:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059955072 00010000:00010000:3.0:1787098249.834606:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877a5 expref: 59 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098249.834647:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:3.0:1787098249.834656:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+59:2374:x1873908059955072:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787098249.834672:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098249.834679:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877a5 expref: 59 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.834692:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877a5 expref: 59 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.834715:0:11681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098249.834720:0:11681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.834743:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.834750:0:11681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098249.834769:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098249.834822:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+59:2374:x1873908059955072:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 166us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098249.834841:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00010000:00010000:1.0:1787098249.838153:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b01454d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877a5 expref: 58 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098249.838181:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b953480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077766784:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098249.838206:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.838217:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.838223:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098249.838275:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787098249.840220:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787098249.840271:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.840645:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b01454e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ac expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.840667:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ac expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.840677:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098249.840681:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787098249.840684:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413000, rc 0) 00000100:00100000:1.0:1787098249.840810:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11651:x1873908059954944:12345-192.168.204.51@tcp:101:bash.0 Request processed in 12876us (13820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098249.840820:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:0.0:1787098249.845384:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.845488:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059955328 00000100:00100000:2.0:1787098249.845499:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059955328 00000100:00100000:2.0:1787098249.845563:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:2.0:1787098249.845574:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+57:11651:x1873908059955328:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1787098249.845858:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11651:x1873908059955328:12345-192.168.204.51@tcp:35:bash.0 Request processed in 285us (484us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787098249.845866:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:0.0:1787098249.903931:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.904044:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059955456 00000100:00100000:2.0:1787098249.904055:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059955456 00000100:00100000:2.0:1787098249.904114:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:2.0:1787098249.904137:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+58:11657:x1873908059955456:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098249.904160:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098249.904180:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b01454f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877b3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.904250:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01454fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.904264:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01454fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.904276:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01454fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098249.904434:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787098249.904438:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098249.904460:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01454fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.904497:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b01454f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877b3 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.904515:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01454fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877b3 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.904524:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:2.0:1787098249.904527:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787098249.904531:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623a00, rc 0) 00000100:00100000:2.0:1787098249.904632:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11657:x1873908059955456:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 496us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.904647:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:3.0:1787098249.910994:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.911482:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059955584 00000100:00100000:2.0:1787098249.911492:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059955584 00000100:00100000:2.0:1787098249.911602:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:2.0:1787098249.911616:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11657:x1873908059955584:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098249.911638:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098249.911660:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0145503 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877ba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.911736:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.911751:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.911763:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.911778:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.911785:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.911792:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.911903:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912089:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912101:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098249.912138:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787098249.912142:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098249.912157:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912168:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912176:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912181:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912187:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912193:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098249.912196:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912214:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912224:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:2.0:1787098249.912227:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098249.912239:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912246:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b014550a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912260:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912265:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912271:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912276:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098249.912338:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912345:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912353:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7203eadc00) 00010000:00010000:2.0:1787098249.912355:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098249.912357:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912362:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b0145511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912392:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0145503 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ba expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912416:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ba expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.912423:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098249.912425:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098249.912427:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622400, rc 0) 00000100:00100000:2.0:1787098249.912483:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11657:x1873908059955584:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 871us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.912490:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:1.0:1787098249.916045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.916103:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059955840 00000100:00100000:2.0:1787098249.916117:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059955840 00000100:00100000:2.0:1787098249.916181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:2.0:1787098249.916192:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11657:x1873908059955840:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1787098249.916231:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098249.916259:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b014551f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877c1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.916397:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.916413:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ac expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.916422:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ba expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.916568:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.916605:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ba expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.916618:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ba expref: 61 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.916632:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077766912:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098249.916852:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ac expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.916862:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ac expref: 61 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.916871:0:5844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077767040:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098249.916895:0:5844:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7105a86780 going to sleep for 11 seconds 00000100:00100000:3.0:1787098249.922311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098249.922405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:1.0:1787098249.922507:0:5844:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.51@tcp) returned -22 from blocking AST (req@00000000e095b135 x1873908077766912) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ba expref: 61 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922529:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ba expref: 61 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922567:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622400/0xb1d871f9b0145518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ba expref: 61 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098249.922584:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077766912:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098249.922599:0:5844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1873908077767040:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098249.922637:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098249.922642:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922652:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922661:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098249.922702:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059955968 00000100:00100000:1.0:1787098249.922711:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059955968 00000100:00100000:1.0:1787098249.922757:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059956096 00000100:00100000:1.0:1787098249.922760:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059956096 00010000:00010000:1.0:1787098249.922771:0:11178:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ac expref: 62 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098249.922794:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:1.0:1787098249.922802:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+62:2373:x1873908059956096:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098249.922815:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098249.922820:0:11178:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ac expref: 62 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922839:0:11178:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ac expref: 62 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922852:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b01454ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877ac expref: 62 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922876:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098249.922879:0:11178:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922887:0:11178:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922894:0:11178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.922913:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098249.923103:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1787098249.923113:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7208e30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+61:2374:x1873908059955968:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098249.923120:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098249.923123:0:5831:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie b1d871f9b0145518) 00010000:00010000:2.0:1787098249.923124:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098249.923839:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+61:2373:x1873908059956096:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1018us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098249.923848:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00010000:00010000:1.0:1787098249.923893:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.923902:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098249.923921:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:2.0:1787098249.924158:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7208e30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+60:2374:x1873908059955968:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1045us (1856us total) trans 0 rc 116/116 00000100:00100000:2.0:1787098249.924182:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00010000:00010000:1.0:1787098249.924416:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b014551f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c1 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.924437:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c1 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.924446:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098249.924454:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787098249.924458:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623800, rc 0) 00000100:00100000:1.0:1787098249.924500:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11657:x1873908059955840:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 8311us (8469us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787098249.924508:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:0.0:1787098249.927763:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.927867:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059956352 00000100:00100000:2.0:1787098249.927878:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059956352 00000100:00100000:2.0:1787098249.928128:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1787098249.928140:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11657:x1873908059956352:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:2.0:1787098249.928156:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098249.928180:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287797 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.928200:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098249.928205:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098249.928352:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11657:x1873908059956352:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 213us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.928361:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1787098249.931019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.931116:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059956480 00000100:00100000:0.0:1787098249.931126:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059956480 00000100:00100000:0.0:1787098249.931192:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:0.0:1787098249.931203:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11657:x1873908059956480:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:0.0:1787098249.931357:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.931374:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.931393:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787098249.931675:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787098249.931768:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11657:x1873908059956480:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 566us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098249.931777:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:1.0:1787098249.933465:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.933612:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059956608 00000100:00100000:0.0:1787098249.933622:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059956608 00000100:00100000:1.0:1787098249.933742:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:1.0:1787098249.933753:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+59:11657:x1873908059956608:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1787098249.933773:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098249.933793:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b014553b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877c8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.933862:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.933873:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b014553b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c8 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.933893:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.933906:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b014553b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c8 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.933919:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098249.933922:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787098249.933925:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b014553b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c8 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.933951:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413e00, rc 0) 00000100:00100000:1.0:1787098249.934100:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11657:x1873908059956608:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 349us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098249.934108:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 214 00000040:00080000:3.0:1787098249.935491:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787098249.935499:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787098249.935568:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787098249.935577:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787098249.935690:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d710595f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077767168:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787098249.935813:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098249.941588:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d710595f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077767168:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787098249.942458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098249.942773:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059956736 00000100:00100000:1.0:1787098249.942782:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059956736 00000100:00100000:1.0:1787098249.942851:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:1.0:1787098249.942862:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11658:x1873908059956736:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787098249.942896:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787098249.945424:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11658:x1873908059956736:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 2554us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098249.945439:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:1.0:1787098249.951133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.951700:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059956864 00000100:00100000:0.0:1787098249.951711:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059956864 00000100:00100000:0.0:1787098249.951787:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:0.0:1787098249.951798:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11658:x1873908059956864:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787098249.951884:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.951901:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.951912:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.951927:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952388:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952396:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952440:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952462:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952469:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098249.952512:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787098249.952516:0:6853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098249.952528:0:6853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952539:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952544:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952551:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952557:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098249.952560:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952567:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952580:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:0.0:1787098249.952589:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098249.952595:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952601:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b0145542 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952618:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952624:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952629:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952634:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098249.952637:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952643:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952652:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d7208701000) 00010000:00010000:0.0:1787098249.952654:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098249.952833:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952841:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145549 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952857:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952868:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952873:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952879:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098249.952882:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952888:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952896:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098249.952899:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098249.952902:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.952907:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b0145550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098249.953078:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11658:x1873908059956864:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 1279us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098249.953089:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:0.0:1787098249.956475:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.956599:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059957120 00000100:00100000:2.0:1787098249.956610:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059957120 00000100:00100000:2.0:1787098249.956662:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:2.0:1787098249.956673:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+60:11658:x1873908059957120:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098249.956695:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098249.956717:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0145557 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877cf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.956903:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.956918:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957016:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098249.957030:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787098249.957169:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957177:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957183:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957188:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098249.957192:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957378:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957394:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098249.957398:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787098249.957403:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957409:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014555e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957458:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0145557 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877cf expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957481:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:2.0:1787098249.957483:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098249.957488:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622e00/0xb1d871f9b0145557 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877cf expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.957498:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622e00, rc 0) 00000100:00100000:2.0:1787098249.957562:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+61:11658:x1873908059957120:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 890us (1097us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787098249.957570:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:3.0:1787098249.961581:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098249.961880:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059957248 00000100:00100000:1.0:1787098249.961889:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059957248 00000100:00100000:1.0:1787098249.961952:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:1.0:1787098249.961971:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+61:11658:x1873908059957248:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787098249.962032:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787098249.962145:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+61:11658:x1873908059957248:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 176us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098249.962153:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:1.0:1787098249.967762:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.970496:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059957504 00000100:00100000:0.0:1787098249.970517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059957504 00000100:00100000:0.0:1787098249.970603:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00100000:0.0:1787098249.970613:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+61:11658:x1873908059957504:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098249.970652:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098249.970655:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787098249.970976:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01454fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877b3 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.970999:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:0.0:1787098249.971005:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787098249.971020:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014556c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877d6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787098249.971621:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1787098249.971994:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.972009:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.972019:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.972079:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695200/0xb1d871f9b014556c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877d6 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.972095:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877d6 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.972103:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7208701000) 00010000:00010000:0.0:1787098249.972106:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098249.972119:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:0.0:1787098249.972371:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+62:11658:x1873908059957504:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1758us (4625us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787098249.972380:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00100000:2.0:1787098249.978872:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098249.978977:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059957760 00000100:00100000:1.0:1787098249.978987:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059957760 00000100:00100000:1.0:1787098249.979061:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:1.0:1787098249.979071:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+62:11658:x1873908059957760:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787098249.979131:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098249.979160:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877d6 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979197:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7208701000) 00010000:00010000:1.0:1787098249.979208:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787098249.979227:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979240:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979249:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979263:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979271:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979312:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979398:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979407:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979425:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979431:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098249.979436:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979444:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979454:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:1.0:1787098249.979456:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098249.979460:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979466:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145581 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979477:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979482:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979487:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979493:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098249.979496:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979511:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979518:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbb30d890 (ffff8d7208d7fe00) 00010000:00010000:1.0:1787098249.979520:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098249.979523:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098249.979528:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145588 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbb30d890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098249.979621:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+61:11658:x1873908059957760:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 550us (758us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787098249.979629:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:3.0:1787098249.984766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098249.984964:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059957888 00000100:00100000:2.0:1787098249.984974:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059957888 00000100:00100000:2.0:1787098249.985038:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 221 00000100:00100000:2.0:1787098249.985048:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+61:11658:x1873908059957888:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098249.985069:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098249.985090:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014558f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877dd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.985124:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.985135:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.985146:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.985263:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227622600/0xb1d871f9b014558f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877dd expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.985337:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877dd expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.985346:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:2.0:1787098249.985349:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787098249.985352:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623600, rc 0) 00000100:00100000:2.0:1787098249.985422:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+62:11658:x1873908059957888:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 375us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098249.985430:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 221 00000100:00100000:2.0:1787098249.989235:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.990069:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059958144 00000100:00100000:0.0:1787098249.990080:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059958144 00000100:00100000:0.0:1787098249.990196:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:0.0:1787098249.990208:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+62:11658:x1873908059958144:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787098249.990340:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.990371:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.990384:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787098249.990654:0:6853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1787098249.990758:0:6853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ab92c1f reply state 000000005334dce9 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098249.990768:0:6853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787098249.990882:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+64:11658:x1873908059958144:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 674us (1656us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787098249.990890:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 222 00010000:00010000:2.0:1787098249.993130:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.993147:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.993155:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.993162:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098249.993166:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.993173:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.993211:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:2.0:1787098249.993214:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787098249.993219:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098249.993226:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b014559d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098249.995866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098249.996084:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059958272 00000100:00100000:0.0:1787098249.996095:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059958272 00000100:00100000:0.0:1787098249.996153:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 223 00000100:00100000:0.0:1787098249.996162:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+63:11658:x1873908059958272:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098249.996202:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098249.996226:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877e4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.996315:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877e4 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.996331:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877e4 expref: 64 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098249.996351:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:0.0:1787098249.996355:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098249.996359:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695000, rc 0) 00000100:00100000:0.0:1787098249.996431:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+64:11658:x1873908059958272:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 270us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098249.996439:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 223 00000100:00100000:3.0:1787098250.000635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098250.000900:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059958400 00000100:00100000:2.0:1787098250.000911:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059958400 00000100:00100000:2.0:1787098250.001004:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:2.0:1787098250.001015:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2374:x1873908059958400:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787098250.001379:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+10:2374:x1873908059958400:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 365us (753us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787098250.001388:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00080000:0.0:1787098250.001768:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787098250.004794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098250.005120:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059958656 00000100:00100000:2.0:1787098250.005131:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059958656 00000100:00100000:2.0:1787098250.005205:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:2.0:1787098250.005214:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d710595f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+64:11658:x1873908059958656:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787098250.005481:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d710595f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+65:11658:x1873908059958656:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 267us (697us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787098250.005488:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00080000:0.0:1787098250.006243:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098250.008511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098250.009208:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059958912 00000100:00100000:2.0:1787098250.009219:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059958912 00000100:00100000:2.0:1787098250.009326:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:2.0:1787098250.009355:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+65:11658:x1873908059958912:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787098250.009487:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+65:11658:x1873908059958912:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 134us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098250.009495:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:3.0:1787098250.017414:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098250.017523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059959040 00000100:00100000:0.0:1787098250.017534:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059959040 00000100:00100000:0.0:1787098250.017611:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 225 00000100:00100000:0.0:1787098250.017622:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+65:11658:x1873908059959040:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098250.017644:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098250.017668:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01455ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877eb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.017761:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.017792:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.017805:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098250.017855:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098250.017876:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.017907:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695e00/0xb1d871f9b01455ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877eb expref: 67 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.018178:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877eb expref: 66 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.018189:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:0.0:1787098250.018192:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787098250.018195:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694c00, rc 0) 00000100:00100000:0.0:1787098250.018270:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+66:11658:x1873908059959040:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 649us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098250.018277:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 225 00000100:00100000:3.0:1787098250.021687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098250.021815:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059959168 00000100:00100000:2.0:1787098250.021835:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059959168 00000100:00100000:2.0:1787098250.021903:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1787098250.021913:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+10:2373:x1873908059959168:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098250.021949:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098250.021978:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877f2 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098250.022004:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a84f489, blocks: 0x1 00010000:00010000:2.0:1787098250.022024:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1787098250.022029:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098250.022038:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f2 expref: 11 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.022058:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f2 expref: 11 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.022071:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622600, rc 0) 00000100:00100000:2.0:1787098250.022130:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+11:2373:x1873908059959168:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 219us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098250.022137:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1787098250.028376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098250.028522:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059959424 00000100:00100000:2.0:1787098250.028534:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059959424 00000100:00100000:2.0:1787098250.028607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:2.0:1787098250.028619:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+66:11658:x1873908059959424:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787098250.028735:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+66:11658:x1873908059959424:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 118us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098250.028743:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:1.0:1787098250.033635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098250.033745:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059959552 00000100:00100000:3.0:1787098250.033756:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059959552 00000100:00100000:3.0:1787098250.034106:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:3.0:1787098250.034119:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+11:11658:x1873908059959552:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787098250.034140:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098250.034160:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52877f9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.034195:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f2 expref: 12 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.034204:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098250.034209:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098250.034214:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.034247:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f2 expref: 12 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.034261:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f2 expref: 12 pid: 6703 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098250.034275:0:6702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1873908077767296:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098250.034405:0:6702:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720690ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098250.037528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098250.037678:0:6702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba17800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1873908077767296:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098250.037720:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.037744:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030400, rc 0) 00000100:00100000:1.0:1787098250.037806:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+12:11658:x1873908059959552:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3690us (4181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098250.037817:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:0.0:1787098250.038203:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059959680 00000100:00100000:0.0:1787098250.038212:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059959680 00010000:00010000:0.0:1787098250.038246:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f2 expref: 12 pid: 6703 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.038305:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:0.0:1787098250.038333:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+12:2374:x1873908059959680:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098250.038348:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098250.038369:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f2 expref: 12 pid: 6703 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.038383:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f2 expref: 12 pid: 6703 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.038407:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000810114ef/0xb1d871f9b01455b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f2 expref: 12 pid: 6703 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.038421:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098250.038426:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098250.038434:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.038444:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.038482:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.038498:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1873908077767424:192.168.204.51@tcp:105: 00000100:00100000:0.0:1787098250.038571:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787098250.043402:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098250.043758:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1873908077767424:192.168.204.51@tcp:105: 00010000:00010000:0.0:1787098250.043793:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098250.043860:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+11:2374:x1873908059959680:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 5529us (6340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098250.043872:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:2.0:1787098250.044651:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059959808 00000100:00100000:2.0:1787098250.044662:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059959808 00002000:00100000:2.0:1787098250.044711:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d7207460700 x1873908059959808/t0(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:426/0 lens 504/0 e 0 to 0 dl 1787098261 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787098250.044723:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7207460700 with x1873908059959808 ext(0->12) 00002000:00010000:2.0:1787098250.044728:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d7207460700 00000100:00100000:2.0:1787098250.044757:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1787098250.044767:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+11:2374:x1873908059959808:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787098250.045325:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2374:x1873908059959808:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 557us (1931us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787098250.045334:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00002000:00100000:2.0:1787098250.045342:0:6708:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8d7207460700 x1873908059959808/t4294967320(0) o4->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:426/0 lens 504/448 e 0 to 0 dl 1787098261 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787098250.045351:0:6708:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d7207460700 with x1873908059959808 ext(0->12) 00002000:00010000:2.0:1787098250.045354:0:6708:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d7207460700 00000100:00100000:3.0:1787098250.049041:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098250.049188:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059959936 00000100:00100000:2.0:1787098250.049199:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059959936 00000100:00100000:2.0:1787098250.049324:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 227 00000100:00100000:2.0:1787098250.049349:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d722745e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+66:11658:x1873908059959936:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787098250.089229:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d722745e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+66:11658:x1873908059959936:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 39872us (40191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098250.089243:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 227 00000001:00080000:0.0:1787098250.089378:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1787098250.089394:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787098250.089410:0:5866:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d720654eb40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787098250.089415:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d7204874900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d720654e600 00000020:00080000:0.0:1787098250.089417:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d7204874d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7241b22800 00000020:00080000:0.0:1787098250.089459:0:5866:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1787098250.089464:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1787098250.089497:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787098250.089520:0:5866:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d7203f39b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787098250.089523:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d720a347500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d7203f393c0 00000020:00080000:0.0:1787098250.089526:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d720a347600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7241adb400 00000100:00100000:3.0:1787098250.089774:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077767552:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787098250.089853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098250.089917:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077767552 00000100:00100000:3.0:1787098250.089936:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077767552 00000100:00100000:3.0:1787098250.090173:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787098250.090182:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d724118dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1873908077767552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787098250.090208:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787098250.090242:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a84f489, atime: 0x6a84f489, ctime: 0x6a84f489, blocks: 0x1 00010000:00010000:3.0:1787098250.090253:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.090269:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1787098250.090273:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098250.090307:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.090323:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.090332:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.090339:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.090367:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787098250.091191:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d724118dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3311:x1873908077767552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1006us (1335us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787098250.091200:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1787098250.091414:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7241b0e680/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787098250.091423:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077767552:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1787098250.091518:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787098250.091528:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098250.091535:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.091556:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098250.091561:0:6716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.091570:0:6716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.091602:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.091610:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945a2b77/0xb1d871f9b01455c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.091633:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098250.091635:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098250.091637:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787098250.093447:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787098250.093708:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787098250.094795:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098250.095121:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059960064 00000100:00100000:2.0:1787098250.095132:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059960064 00000100:00100000:2.0:1787098250.095187:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:2.0:1787098250.095197:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+13:2374:x1873908059960064:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787098250.099078:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077767680:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787098250.099153:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098250.102738:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077767680 00000100:00100000:3.0:1787098250.102751:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077767680 00000100:00100000:3.0:1787098250.102812:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787098250.102831:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1873908077767680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787098250.102860:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787098250.102887:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.102909:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287758 expref: 13 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.102919:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787098250.102923:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787098250.102935:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.102982:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287758 expref: 13 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.102996:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287758 expref: 13 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098250.103011:0:6702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241b0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1873908077767808:192.168.204.51@tcp:104: 00000100:00080000:1.0:1787098250.103174:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787098250.104879:0:6702:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204989180 going to sleep for 11 seconds 00000100:00100000:2.0:1787098250.111631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098250.111694:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059960192 00000100:00100000:0.0:1787098250.111704:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059960192 00010000:00010000:0.0:1787098250.111753:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287758 expref: 14 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.111795:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:0.0:1787098250.111805:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+14:2374:x1873908059960192:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098250.111830:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098250.111837:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287758 expref: 14 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.111853:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287758 expref: 14 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.111894:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098250.111899:0:11681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098250.111906:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.111917:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.111941:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098250.112124:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+14:2374:x1873908059960192:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 318us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098250.112133:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00010000:00010000:3.0:1787098250.114465:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b0145389 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287758 expref: 13 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098250.114488:0:6702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241b0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6702:1873908077767808:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098250.114511:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.114521:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.114527:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.114537:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.114573:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.114600:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787098250.115244:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1873908077767680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12421us (16087us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787098250.115254:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1787098250.115329:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d723b952a00/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787098250.115342:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077767680:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787098250.115937:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098250.115946:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.115966:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200031200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098250.115971:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.115981:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.116001:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.116025:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3afc91f/0xb1d871f9b01455ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.116047:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098250.116049:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098250.116051:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787098250.144742:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1787098250.145036:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1787098250.145048:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1787098250.145229:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059960064:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 50026us (50433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098250.145242:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:2.0:1787098250.148644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098250.148841:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059960448 00000100:00100000:1.0:1787098250.148867:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059960448 00000100:00100000:1.0:1787098250.149040:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:1.0:1787098250.149052:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+20:11658:x1873908059960448:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787098250.149112:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098250.149141:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877eb expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.149163:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:1.0:1787098250.149169:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787098250.149202:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.149216:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.149226:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787098250.149508:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000285f49e8 reply state 0000000019e83534 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098250.149517:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787098250.149850:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+21:11658:x1873908059960448:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 798us (1213us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787098250.149858:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:2.0:1787098250.152939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:3.0:1787098250.153707:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.153732:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.153739:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.153745:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098250.153749:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.153756:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.153786:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:3.0:1787098250.153789:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098250.153794:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.153799:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b01455d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.154066:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059960576 00000100:00100000:0.0:1787098250.154077:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059960576 00000100:00100000:0.0:1787098250.154136:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:0.0:1787098250.154146:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059960576:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787098250.154380:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787098250.154384:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787098249 00002000:00010000:0.0:1787098250.154386:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787098249 00002000:00010000:0.0:1787098250.154388:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787098249 -> 1787098249 00002000:00010000:0.0:1787098250.154391:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787098250.154449:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059960576:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 306us (1525us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787098250.154457:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:2.0:1787098250.156663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098250.156947:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059960832 00000100:00100000:0.0:1787098250.156957:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059960832 00000100:00100000:0.0:1787098250.157012:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:0.0:1787098250.157021:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+20:11658:x1873908059960832:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787098250.157106:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.157123:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877dd expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.157131:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.157165:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877dd expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.157178:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877dd expref: 20 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.157192:0:5843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077767936:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098250.157307:0:5843:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787098250.159905:0:5843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1873908077767936:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098250.159943:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098250.161088:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098250.161159:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059960960 00000100:00100000:1.0:1787098250.161168:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059960960 00010000:00010000:1.0:1787098250.161206:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877dd expref: 21 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098250.161271:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:1.0:1787098250.161312:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+21:2373:x1873908059960960:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098250.161329:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098250.161336:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877dd expref: 21 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.161349:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877dd expref: 21 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.161371:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623600/0xb1d871f9b0145596 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877dd expref: 21 pid: 5845 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.161387:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:1.0:1787098250.161393:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.161402:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.161409:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.161436:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098250.161480:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+20:2373:x1873908059960960:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 201us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098250.161488:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00010000:00010000:3.0:1787098250.161561:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.161569:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.161597:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.161605:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.161611:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.161617:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098250.161621:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.161628:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.161647:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:3.0:1787098250.161650:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787098250.161653:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.161659:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098250.161695:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+19:11658:x1873908059960832:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 4676us (5041us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787098250.161702:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:2.0:1787098250.164582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098250.164694:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059961088 00000100:00100000:3.0:1787098250.164702:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059961088 00000100:00100000:3.0:1787098250.164764:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1787098250.164773:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106023b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2375:x1873908059961088:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787098250.164814:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.164844:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.164852:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098250.164857:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787098250.164862:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.164893:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.164919:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 8 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098250.164944:0:6701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241b0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1873908077768064:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098250.165024:0:6701:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204989e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787098250.168792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098250.168988:0:6701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241b0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6701:1873908077768064:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098250.169017:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.169223:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059961216 00000100:00100000:0.0:1787098250.169232:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059961216 00010000:00010000:0.0:1787098250.169270:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 9 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.169356:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:0.0:1787098250.169366:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+9:2373:x1873908059961216:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098250.169398:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098250.169423:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 9 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.169435:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 9 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.169458:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009aa71ab0/0xb1d871f9b01455c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877f9 expref: 9 pid: 6702 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.169476:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098250.169481:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787098250.169486:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.169496:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.169526:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098250.169581:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106023100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2373:x1873908059961216:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 216us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098250.169589:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00010000:00010000:3.0:1787098250.170218:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.170231:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.170258:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.170266:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.170273:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.170323:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098250.170327:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.170336:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.170349:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098250.170357:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013509c86/0xb1d871f9b01455e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098250.170429:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106023b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2375:x1873908059961088:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 5655us (5853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098250.170438:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1787098250.174473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098250.174632:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059961472 00000100:00100000:0.0:1787098250.174643:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059961472 00000100:00100000:0.0:1787098250.174745:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 230 00000100:00100000:0.0:1787098250.174756:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+19:11658:x1873908059961472:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787098250.174870:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.174888:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.174900:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.175388:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.175401:0:6853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877e4 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.175409:0:6853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.175445:0:6853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877e4 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.175458:0:6853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877e4 expref: 20 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.175472:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077768192:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098250.175563:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787098250.179950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098250.180157:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059961600 00000100:00100000:1.0:1787098250.180178:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059961600 00010000:00010000:1.0:1787098250.180217:0:11681:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877e4 expref: 21 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098250.180257:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:1.0:1787098250.180266:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7208e32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+21:2374:x1873908059961600:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098250.180314:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098250.180323:0:11681:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877e4 expref: 21 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.180336:0:11681:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877e4 expref: 21 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.180360:0:11681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:1.0:1787098250.180366:0:11681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.180376:0:11681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.180383:0:11681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.180402:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098250.180454:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7208e32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+21:2374:x1873908059961600:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 189us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098250.180462:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00010000:00010000:0.0:1787098250.182155:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877e4 expref: 20 pid: 5843 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.182181:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077768192:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098250.182220:0:6853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.182230:0:6853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.182236:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787098250.182528:0:6853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787098250.182699:0:6853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787098250.182839:0:6853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787098250.182942:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6853:1873908077768320:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787098250.183188:0:6853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098250.183311:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098250.183810:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077768320 00000100:00100000:1.0:1787098250.183838:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077768320 00000100:00100000:1.0:1787098250.184170:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787098250.184181:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6853:x1873908077768320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787098250.184306:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6853:x1873908077768320:12345-0@lo:1000:mdt00_003.0 Request processed in 127us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098250.184314:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787098250.184412:0:6853:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1787098250.184417:0:6853:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d723ba14a80, transno 4294967315 00000004:00080000:0.0:1787098250.184424:0:6853:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1787098250.184448:0:6853:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d723b952a00 x1873908077767680/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787098266 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098250.184460:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6853:1873908077768320:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787098250.185475:0:6853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787098250.185629:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6853:1873908077768448:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787098250.185683:0:6853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098250.186179:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787098250.186236:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077768448 00000100:00100000:2.0:1787098250.186244:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077768448 00000100:00100000:2.0:1787098250.186305:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787098250.186315:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6853:x1873908077768448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787098250.186515:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6853:x1873908077768448:12345-0@lo:1000:mdt00_003.0 Request processed in 201us (830us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787098250.186523:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787098250.186707:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6853:1873908077768448:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787098250.186829:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.186855:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.186862:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.186869:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098250.186873:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.186880:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.186897:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203eadc00) 00010000:00010000:0.0:1787098250.186900:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098250.186904:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.186910:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694c00/0xb1d871f9b01455f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.187112:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.187119:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.187123:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.187128:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098250.187138:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.187143:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.187152:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098250.187154:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098250.187162:0:6853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b014553b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c8 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.187172:0:6853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b014553b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c8 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.187181:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b014553b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c8 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.187210:0:6853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b014553b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c8 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.187222:0:6853:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b954000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077768576:192.168.204.51@tcp:105: 00000100:00100000:0.0:1787098250.189979:0:6853:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720654e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787098250.198124:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098250.198239:0:6853:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b954000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6853:1873908077768576:192.168.204.51@tcp:105: 00010000:00010000:0.0:1787098250.198269:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198315:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695800/0xb1d871f9b0145534 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198363:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198376:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198387:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198397:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198404:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198410:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198416:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098250.198420:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198427:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198438:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098250.198441:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098250.198445:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198450:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b01455f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198468:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198474:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198480:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198485:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098250.198488:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198493:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198500:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098250.198502:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787098250.198504:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098250.198509:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b01455ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098250.198776:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+23:11658:x1873908059961472:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 24020us (24310us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787098250.198787:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 230 00000020:00080000:0.0:1787098250.198793:0:6853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787098250.199205:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098250.199210:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098250.199713:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787098250.199732:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787098250.205396:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059961728 00000100:00100000:3.0:1787098250.205413:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059961728 00000100:00100000:2.0:1787098250.205616:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:2.0:1787098250.205627:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+23:11657:x1873908059961728:12345-192.168.204.51@tcp:49:lfs.0 00000100:00100000:2.0:1787098250.205918:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+23:11657:x1873908059961728:12345-192.168.204.51@tcp:49:lfs.0 Request processed in 292us (7802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098250.205951:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1787098250.207623:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098250.207763:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059961984 00000100:00100000:2.0:1787098250.207774:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059961984 00000100:00100000:2.0:1787098250.207838:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:2.0:1787098250.207848:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+23:11658:x1873908059961984:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787098250.208593:0:5847:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787098250.208702:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787098250.208749:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.208766:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.208776:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.208784:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.208791:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.208797:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.208833:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787098250.208856:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098250.208863:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.208870:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098250.208874:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.208881:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.208893:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d7203ead300) 00010000:00010000:1.0:1787098250.208896:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787098250.208900:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.208916:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b01455ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098250.208926:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+25:11658:x1873908059961984:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1078us (1309us total) trans 4294967514 rc 0/0 00010000:00010000:1.0:1787098250.208933:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098250.208934:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00010000:00010000:1.0:1787098250.208935:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098250.208936:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787098250.208946:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787098250.212431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098250.212958:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059962240 00000100:00100000:1.0:1787098250.212969:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059962240 00000100:00100000:1.0:1787098250.213036:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 231 00000100:00100000:1.0:1787098250.213046:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+25:11657:x1873908059962240:12345-192.168.204.51@tcp:58:lfs.0 00000040:00080000:1.0:1787098250.213451:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787098250.213545:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+25:11657:x1873908059962240:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 499us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098250.213554:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 231 00000100:00100000:2.0:1787098250.239547:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098250.239787:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059962368 00000100:00100000:3.0:1787098250.239798:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059962368 00000100:00100000:0.0:1787098250.240107:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 232 00000100:00100000:0.0:1787098250.240120:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+25:11660:x1873908059962368:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098250.240182:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098250.240204:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145606 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287800 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241112:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241132:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241143:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241159:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241166:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241172:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241483:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241497:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c1 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241517:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241569:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c1 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.241582:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c1 expref: 26 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098250.241596:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b950000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077768704:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098250.241695:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720ff73d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787098250.244376:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b950000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1873908077768704:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098250.244407:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098250.244517:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098250.245518:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059962624 00000100:00100000:1.0:1787098250.245528:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059962624 00000100:00100000:1.0:1787098250.245644:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1787098250.245655:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+27:5609:x1873908059962624:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787098250.245927:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+28:5609:x1873908059962624:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 273us (1409us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787098250.245935:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1787098250.248087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098250.248250:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059962752 00000100:00100000:0.0:1787098250.248260:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059962752 00010000:00010000:0.0:1787098250.248328:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c1 expref: 28 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098250.248562:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:1.0:1787098250.248575:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+28:2373:x1873908059962752:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098250.248592:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098250.248612:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c1 expref: 28 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.248625:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c1 expref: 28 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.248648:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623800/0xb1d871f9b0145526 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c1 expref: 28 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.248665:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098250.248676:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.248685:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.248692:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098250.248724:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098250.248785:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+27:2373:x1873908059962752:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 213us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098250.248794:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00010000:00010000:2.0:1787098250.248877:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.248886:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098250.248928:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787098250.248933:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787098250.248952:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.248975:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.248985:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.248992:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.248998:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249005:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098250.249009:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249017:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249034:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:2.0:1787098250.249037:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098250.249040:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249045:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b014560d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249055:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249061:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249067:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249083:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098250.249086:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249092:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249099:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d7208d7fe00) 00010000:00010000:2.0:1787098250.249102:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098250.249105:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249111:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412c00/0xb1d871f9b0145614 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249159:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287800 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249173:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287800 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098250.249179:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098250.249181:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098250.249184:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412200, rc 0) 00000100:00100000:2.0:1787098250.249211:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+26:11660:x1873908059962368:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 9095us (9677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098250.249218:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 232 00010000:00010000:0.0:1787098250.639620:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787098251.148788:0:12630:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787098251.148810:0:12630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787098251.148950:0:12630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787098251.148955:0:12630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787098251.219239:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787098251.219247:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787098251.219309:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787098251.219316:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787098251.219461:0:11698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241b0ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077768832:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787098251.219591:0:11698:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209256c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787098251.228417:0:11698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241b0ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1873908077768832:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787098251.228947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098251.229516:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059962880 00000100:00100000:1.0:1787098251.229526:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059962880 00000100:00100000:1.0:1787098251.229582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 233 00000100:00100000:1.0:1787098251.229593:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+26:11672:x1873908059962880:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787098251.229637:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787098251.229755:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+26:11672:x1873908059962880:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 163us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098251.229774:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 233 00000100:00100000:0.0:1787098251.233764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098251.235694:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059963136 00000100:00100000:2.0:1787098251.235708:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059963136 00000100:00100000:2.0:1787098251.235775:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 234 00000100:00100000:2.0:1787098251.235785:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+26:11672:x1873908059963136:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098251.235817:0:6853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098251.235842:0:6853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145622 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287807 expref: -99 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.235951:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0145629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.235984:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0145629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.235998:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0145629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098251.236023:0:6853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787098251.236159:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623e00/0xb1d871f9b0145622 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287807 expref: 29 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.236180:0:6853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0145629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287807 expref: 28 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.236190:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098251.236193:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787098251.236196:0:6853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623a00, rc 0) 00000100:00100000:2.0:1787098251.236270:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+28:11672:x1873908059963136:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 487us (2514us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787098251.236299:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 234 00000100:00100000:1.0:1787098251.249653:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098251.249726:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059963392 00000100:00100000:2.0:1787098251.249736:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059963392 00000100:00100000:2.0:1787098251.249807:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 235 00000100:00100000:2.0:1787098251.249818:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+28:11672:x1873908059963392:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787098251.249895:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.249912:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.249932:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.250119:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.250127:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.250134:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.250141:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098251.250145:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.250154:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.250166:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098251.250169:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787098251.250173:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.250180:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623400/0xb1d871f9b0145637 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098251.250360:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+29:11672:x1873908059963392:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 543us (717us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787098251.250368:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 235 00000040:00080000:1.0:1787098251.250635:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098251.250640:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098251.251214:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787098251.251224:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787098251.260433:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098251.260515:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059963520 00000100:00100000:2.0:1787098251.260525:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059963520 00000100:00100000:2.0:1787098251.260595:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1787098251.260606:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b950a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+29:2374:x1873908059963520:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098251.260624:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098251.260650:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623a00/0xb1d871f9b0145629 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287807 expref: 29 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098251.260670:0:11178:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098251.260674:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098251.260728:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b950a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+28:2374:x1873908059963520:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 124us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098251.260735:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1787098251.260993:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098251.261127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059963776 00000100:00100000:1.0:1787098251.261132:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059963776 00000100:00100000:1.0:1787098251.261169:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1787098251.261176:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+28:11672:x1873908059963776:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787098251.261390:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+29:11672:x1873908059963776:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 213us (397us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787098251.261397:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:0.0:1787098251.293432:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098251.293476:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098251.293490:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059963904 00000100:00100000:2.0:1787098251.293501:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059963904 00000100:00100000:0.0:1787098251.293510:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098251.293537:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098251.293551:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 289 00000100:00100000:0.0:1787098251.293557:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059964032 00000100:00100000:2.0:1787098251.293560:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059963904:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098251.293560:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059964032 00000100:00100000:0.0:1787098251.293588:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059964160 00000100:00100000:0.0:1787098251.293590:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059964160 00000100:00100000:0.0:1787098251.293616:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:0.0:1787098251.293622:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059964032:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098251.293627:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2374:x1873908059963904:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098251.293634:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 289 00000100:00100000:0.0:1787098251.293647:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059964032:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098251.293653:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:0.0:1787098251.293664:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1787098251.293669:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059964160:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098251.293690:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2374:x1873908059964160:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 21us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098251.293707:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00080000:0.0:1787098251.293727:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787098251.293772:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059964288 00000100:00100000:2.0:1787098251.293776:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059964288 00000100:00100000:2.0:1787098251.293826:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:2.0:1787098251.293834:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059964288:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098251.293871:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059964288:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 38us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098251.293887:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00080000:0.0:1787098251.293913:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1787098251.412500:0:6852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349668217640ns, next at 350668215431ns, rc = 0 00000100:00100000:1.0:1787098251.412522:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787098251.412541:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077768960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098251.412603:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098251.418607:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077768960 00000100:00100000:3.0:1787098251.418622:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077768960 00000100:00100000:3.0:1787098251.419209:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787098251.419223:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1873908077768960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787098251.419250:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787098251.419371:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1873908077768960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (6767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098251.419379:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787098251.419523:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b952680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077768960:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787098251.481366:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1787098251.481385:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787098251.481394:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1787098251.663710:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098252.687628:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787098252.993826:0:12684:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787098252.993837:0:12684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787098252.993880:0:12684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787098252.993885:0:12684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787098253.211158:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098253.211197:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059964544 00000100:00100000:3.0:1787098253.211207:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059964544 00000100:00100000:3.0:1787098253.211274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00100000:3.0:1787098253.211304:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+29:11692:x1873908059964544:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098253.211333:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098253.211356:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014563e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528780e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098253.211473:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b0145645 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098253.211500:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b0145645 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098253.211513:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b0145645 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098253.211525:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787098253.211659:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030400/0xb1d871f9b014563e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528780e expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098253.211677:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b0145645 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528780e expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098253.211687:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098253.211690:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787098253.211693:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030600, rc 0) 00000100:00100000:3.0:1787098253.211756:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+31:11692:x1873908059964544:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 455us (621us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787098253.211776:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00080000:3.0:1787098253.211801:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098253.214825:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098253.215597:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059964672 00000100:00100000:1.0:1787098253.215611:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059964672 00000100:00100000:1.0:1787098253.215675:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 237 00000100:00100000:1.0:1787098253.215686:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+31:11692:x1873908059964672:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1787098253.215773:0:6853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098253.215812:0:6853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098253.215825:0:6853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098253.215859:0:6853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098253.216254:0:6853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098253.216262:0:6853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098253.216268:0:6853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098253.216272:0:6853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098253.217024:0:6853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098253.217044:0:6853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:1.0:1787098253.217047:0:6853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787098253.217051:0:6853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098253.217058:0:6853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145653 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098253.217313:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+31:11692:x1873908059964672:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 1625us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098253.217330:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 237 00000100:00100000:3.0:1787098253.301848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098253.301979:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059964800 00000100:00100000:2.0:1787098253.302000:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059964800 00000100:00100000:2.0:1787098253.302093:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:2.0:1787098253.302104:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2376:x1873908059964800:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1787098253.302125:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098253.302149:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a4c1b54/0xb1d871f9b014565a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287815 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098253.302180:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a84f489, atime: 0x6a84f489, ctime: 0x6a84f489, blocks: 0xb 00010000:00010000:2.0:1787098253.302202:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1787098253.302208:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098253.302217:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a4c1b54/0xb1d871f9b014565a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287815 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098253.302236:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a4c1b54/0xb1d871f9b014565a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287815 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098253.302248:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622a00, rc 0) 00000100:00100000:2.0:1787098253.302365:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2376:x1873908059964800:12345-192.168.204.51@tcp:101:cat.0 Request processed in 263us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098253.302372:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00080000:3.0:1787098253.302549:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098253.308200:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098253.308433:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059964928 00000100:00100000:3.0:1787098253.308444:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059964928 00002000:00100000:3.0:1787098253.308524:0:6707:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d723b952680 x1873908059964928/t0(0) o3->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:429/0 lens 488/0 e 0 to 0 dl 1787098264 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787098253.308708:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b952680 with x1873908059964928 ext(0->4095) 00002000:00010000:3.0:1787098253.308716:0:6707:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d723b952680 00000100:00100000:3.0:1787098253.308753:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1787098253.308776:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2374:x1873908059964928:12345-192.168.204.51@tcp:3:cat.0 00000100:00100000:3.0:1787098253.309962:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+8:2374:x1873908059964928:12345-192.168.204.51@tcp:3:cat.0 Request processed in 1182us (1767us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787098253.309973:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00002000:00100000:3.0:1787098253.309982:0:6707:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8d723b952680 x1873908059964928/t0(0) o3->530d6019-f48b-45e0-97e8-95fbd128e52b@192.168.204.51@tcp:429/0 lens 488/4536 e 0 to 0 dl 1787098264 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787098253.309993:0:6707:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d723b952680 with x1873908059964928 ext(0->4095) 00002000:00010000:3.0:1787098253.309997:0:6707:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d723b952680 00010000:00010000:0.0:1787098253.712116:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098253.968196:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077769216:0@lo:400:kworker.0 00000100:00100000:1.0:1787098253.968270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098253.968347:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077769728:0@lo:400:kworker.0 00000100:00100000:1.0:1787098253.968374:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098253.968407:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787098253.968413:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077769344:0@lo:400:kworker.0 00000100:00100000:1.0:1787098253.968435:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098253.968465:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077769728 00000100:00100000:1.0:1787098253.968473:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077769728 00000100:00100000:1.0:1787098253.968531:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787098253.968542:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077769728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098253.968594:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077769728:12345-0@lo:400:kworker.0 Request processed in 54us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098253.968602:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787098253.968630:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077769216 00000100:00100000:1.0:1787098253.968634:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077769216 00000100:00100000:1.0:1787098253.968658:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077769344 00000100:00100000:1.0:1787098253.968661:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077769344 00000100:00100000:1.0:1787098253.968682:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787098253.968689:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077769216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098253.968719:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077769216:12345-0@lo:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098253.968725:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787098253.968737:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787098253.968769:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077769344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098253.968801:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077769344:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098253.968807:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1787098253.968827:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787098253.968832:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787098253.968874:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077769344:0@lo:400:kworker.0 00000100:00100000:1.0:1787098253.968886:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077769216:0@lo:400:kworker.0 00000100:00100000:1.0:1787098253.968894:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787098253.968899:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7106023800, transno 4294967307 00000004:00080000:1.0:1787098253.968910:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787098253.968927:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7241b0e680, transno 4294967310 00000100:00100000:1.0:1787098253.968932:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077769728:0@lo:400:kworker.0 00000100:00100000:2.0:1787098253.969963:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077769088:0@lo:400:kworker.0 00000100:00100000:2.0:1787098253.970015:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098253.970071:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077769600:0@lo:400:kworker.0 00000100:00100000:2.0:1787098253.970098:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098253.970120:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787098253.970126:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077769472:0@lo:400:kworker.0 00000100:00100000:3.0:1787098253.970228:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077769088 00000100:00100000:3.0:1787098253.970233:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077769088 00000100:00100000:3.0:1787098253.970271:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1787098253.970302:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077769088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098253.970345:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3310:x1873908077769088:12345-0@lo:400:kworker.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098253.970352:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787098253.971610:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077769600 00000100:00100000:1.0:1787098253.971620:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077769600 00000100:00100000:1.0:1787098253.971677:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787098253.971684:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077769600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098253.972003:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077769600:12345-0@lo:400:kworker.0 Request processed in 318us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098253.972011:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787098253.972368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098253.972419:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af6522d0-d61c-40bd-bd34-bb282ba82d15:3310:1873908077769088:0@lo:400:kworker.0 00000100:00100000:3.0:1787098253.972435:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077769600:0@lo:400:kworker.0 00000100:00100000:3.0:1787098253.972468:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077769472 00000100:00100000:3.0:1787098253.972484:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077769472 00000100:00100000:3.0:1787098253.972519:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787098253.972527:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1873908077769472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098253.972567:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1873908077769472:12345-0@lo:400:kworker.0 Request processed in 41us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098253.972574:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787098253.972604:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077769472:0@lo:400:kworker.0 00000100:00080000:2.0:1787098253.972831:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787098253.972837:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098254.479755:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077769856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098254.479830:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098254.480035:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077769856 00000100:00100000:0.0:1787098254.480045:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077769856 00000100:00100000:0.0:1787098254.480103:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787098254.480112:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077769856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098254.480152:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098254.480219:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077769856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098254.480226:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787098254.480380:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077769856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787098254.738663:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787098255.375507:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787098255.375516:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787098255.375551:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787098255.375557:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787098255.572428:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1787098255.572458:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787098255.607173:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:3.0:1787098255.607198:0:5866:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d720654e9c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787098255.607205:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d7204874b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d720654ec00 00000020:00080000:3.0:1787098255.607208:0:5866:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8d7204874100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d7105ae1800 00000020:00080000:3.0:1787098255.607242:0:5866:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:3.0:1787098255.607255:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1787098255.607271:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:3.0:1787098255.607319:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:3.0:1787098255.607433:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077769984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787098255.607535:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098255.607630:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077769984 00000100:00100000:3.0:1787098255.607641:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077769984 00000100:00100000:3.0:1787098255.607722:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787098255.607736:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077769984:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1787098255.607751:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1787098255.607918:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787098255.608182:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00002000:00010000:3.0:1787098255.608456:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787098255.608461:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787098249 -> 1787098249 00002000:00010000:3.0:1787098255.608463:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1787098249 -> 1787098249 00002000:00010000:3.0:1787098255.608473:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787098249 -> 1787098249 00002000:00010000:3.0:1787098255.608475:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787098255.608810:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1873908077769984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1074us (1271us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787098255.608834:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787098255.609089:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1787098255.609097:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d723b952a00, transno 4294967321 00000004:00080000:1.0:1787098255.609143:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1787098255.609179:0:3309:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8d7241b0df80 x1873908077769984/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787098271 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787098255.609201:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7241b0df80/2, rc 0, transno 4294967324 00000100:00100000:1.0:1787098255.609792:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077769984:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787098255.765867:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098256.410675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098256.410726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098256.410761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098256.410795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098256.410913:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059965056 00000100:00100000:2.0:1787098256.410929:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059965056 00000100:00100000:2.0:1787098256.411014:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 291 00000100:00100000:2.0:1787098256.411027:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059965056:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098256.411902:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059965312 00000100:00100000:0.0:1787098256.411911:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059965312 00000100:00100000:0.0:1787098256.412001:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1787098256.412012:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059965312:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098256.413270:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d720492b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059965056:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2237us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098256.413298:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 291 00000100:00100000:2.0:1787098256.413444:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059965568 00000100:00100000:2.0:1787098256.413453:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059965568 00000100:00100000:2.0:1787098256.413505:0:6853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059965184 00000100:00100000:2.0:1787098256.413508:0:6853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059965184 00000100:00100000:2.0:1787098256.413530:0:6853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:2.0:1787098256.413555:0:6853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059965568:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098256.415346:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098256.415630:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059965440 00000100:00100000:3.0:1787098256.415640:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059965440 00000100:00100000:3.0:1787098256.415709:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:3.0:1787098256.415722:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059965440:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098256.415799:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2373:x1873908059965440:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 81us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098256.416065:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:1.0:1787098256.416581:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:1.0:1787098256.416602:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:2373:x1873908059965184:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098256.416720:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:2373:x1873908059965184:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 125us (5923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098256.416729:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:0.0:1787098256.417819:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2373:x1873908059965312:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 5801us (7083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098256.417833:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00080000:0.0:1787098256.417875:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787098256.417884:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787098256.417890:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098256.429988:0:6853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:2373:x1873908059965568:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 16410us (19203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098256.430013:0:6853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:2.0:1787098256.527984:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077770112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787098256.528089:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098256.528266:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077770112 00000100:00100000:0.0:1787098256.528311:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077770112 00000100:00100000:0.0:1787098256.528389:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787098256.528402:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1873908077770112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098256.528478:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098256.528554:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1873908077770112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098256.528564:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787098256.528672:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077770112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787098256.783822:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098257.814186:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098258.078364:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098258.078454:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059965696 00000100:00100000:2.0:1787098258.078474:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059965696 00000100:00100000:2.0:1787098258.078561:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00100000:2.0:1787098258.078572:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:11336:x1873908059965696:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787098258.078695:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:11336:x1873908059965696:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 125us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098258.078703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00080000:0.0:1787098258.078831:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098258.096662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098258.096833:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059965952 00000100:00100000:2.0:1787098258.096844:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059965952 00000100:00100000:2.0:1787098258.096912:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:2.0:1787098258.096922:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+18:11336:x1873908059965952:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787098258.097494:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+19:11336:x1873908059965952:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 571us (840us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787098258.097503:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1787098258.460747:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098258.461017:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059966080 00000100:00100000:0.0:1787098258.461031:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059966080 00000100:00100000:0.0:1787098258.461121:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:0.0:1787098258.461133:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+5:12143:x1873908059966080:12345-192.168.204.51@tcp:101:lsof.0 00010000:00010000:0.0:1787098258.461154:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098258.461178:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528781c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098258.461254:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145668 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098258.461269:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098258.461318:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098258.461697:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787098258.461703:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098258.461783:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098258.461811:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208694400/0xb1d871f9b0145661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528781c expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098258.461839:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145668 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528781c expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098258.461849:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:0.0:1787098258.461852:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787098258.461856:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695000, rc 0) 00000100:00100000:0.0:1787098258.461937:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:12143:x1873908059966080:12345-192.168.204.51@tcp:101:lsof.0 Request processed in 806us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098258.461944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00080000:2.0:1787098258.462251:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787098258.832827:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098259.087767:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077770240:0@lo:400:kworker.0 00000100:00100000:1.0:1787098259.087844:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098259.087906:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077770752:0@lo:400:kworker.0 00000100:00100000:1.0:1787098259.087935:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098259.087964:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787098259.087970:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077770368:0@lo:400:kworker.0 00000100:00100000:1.0:1787098259.087992:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098259.088007:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077770880:0@lo:400:kworker.0 00000100:00100000:1.0:1787098259.088032:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098259.088062:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077770752 00000100:00100000:1.0:1787098259.088069:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077770752 00000100:00100000:1.0:1787098259.088118:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077770368 00000100:00100000:1.0:1787098259.088121:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077770368 00000100:00100000:1.0:1787098259.088143:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787098259.088151:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077770752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098259.088202:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077770752:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098259.088222:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787098259.088237:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787098259.088242:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077770368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098259.088268:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077770368:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098259.088274:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787098259.088336:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077770368:0@lo:400:kworker.0 00000100:00100000:1.0:1787098259.088347:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077770752:0@lo:400:kworker.0 00000100:00100000:3.0:1787098259.088493:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077770496:0@lo:400:kworker.0 00000100:00100000:3.0:1787098259.088524:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098259.088562:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098259.088575:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077770240 00000100:00100000:3.0:1787098259.088578:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077770624:0@lo:400:kworker.0 00000100:00100000:0.0:1787098259.088580:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077770240 00000100:00100000:3.0:1787098259.088602:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098259.088606:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787098259.088613:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077770240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098259.088629:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077770880 00000100:00100000:3.0:1787098259.088632:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077770880 00000100:00100000:0.0:1787098259.088664:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077770240:12345-0@lo:400:kworker.0 Request processed in 52us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098259.088671:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077770624 00000100:00100000:0.0:1787098259.088671:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787098259.088674:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077770624 00000100:00100000:3.0:1787098259.088703:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787098259.088709:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077770880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098259.088715:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787098259.088721:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1873908077770624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098259.088742:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077770880:12345-0@lo:400:kworker.0 Request processed in 34us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098259.088748:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787098259.088761:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1873908077770624:12345-0@lo:400:kworker.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098259.088767:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787098259.088826:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077770624:0@lo:400:kworker.0 00000100:00080000:2.0:1787098259.089056:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787098259.089067:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787098259.089070:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098259.089081:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077770496 00000100:00100000:2.0:1787098259.089085:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077770496 00000100:00100000:2.0:1787098259.089128:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787098259.089135:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077770496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098259.089173:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077770496:12345-0@lo:400:kworker.0 Request processed in 39us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098259.089179:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787098259.089882:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077770880:0@lo:400:kworker.0 00000100:00100000:1.0:1787098259.089893:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077770240:0@lo:400:kworker.0 00000100:00080000:3.0:1787098259.093733:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098259.093826:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b954e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077770496:0@lo:400:kworker.0 00000100:00100000:3.0:1787098259.600163:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077771008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098259.600236:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098259.600705:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077771008 00000100:00100000:0.0:1787098259.600715:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077771008 00000100:00100000:0.0:1787098259.600771:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787098259.600780:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077771008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787098259.600829:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098259.600891:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077771008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098259.600898:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787098259.601094:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077771008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787098259.858335:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787098260.669576:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00080000:0.0:1787098260.681730:0:5866:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787098260.681769:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787098260.681781:0:5877:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1787098260.681939:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:2.0:1787098260.879622:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098261.533202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098261.533562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098261.533592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098261.533629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098261.533658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098261.533696:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059966464 00000100:00100000:0.0:1787098261.533710:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059966464 00000100:00100000:0.0:1787098261.533785:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059966592 00000100:00100000:0.0:1787098261.533789:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059966592 00000100:00100000:0.0:1787098261.533818:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:0.0:1787098261.533830:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2375:x1873908059966464:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098261.536415:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2375:x1873908059966464:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2566us (2832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098261.536436:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:0.0:1787098261.536485:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:0.0:1787098261.536504:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059966592:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098261.536617:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2375:x1873908059966592:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 123us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098261.536625:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:0.0:1787098261.536690:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059966720 00000100:00100000:0.0:1787098261.536700:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059966720 00000100:00100000:0.0:1787098261.536759:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059966336 00000100:00100000:0.0:1787098261.536763:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059966336 00000100:00100000:0.0:1787098261.536794:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:0.0:1787098261.536801:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2375:x1873908059966720:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098261.536833:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2375:x1873908059966720:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (3241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098261.536840:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:0.0:1787098261.536851:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:0.0:1787098261.536858:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+18:2375:x1873908059966336:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098261.536894:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+18:2375:x1873908059966336:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 37us (3265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098261.536901:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00080000:0.0:1787098261.536932:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787098261.536938:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787098261.536942:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098261.538900:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059966208 00000100:00100000:2.0:1787098261.538918:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059966208 00000100:00100000:2.0:1787098261.538987:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 293 00000100:00100000:2.0:1787098261.538999:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059966208:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098261.541056:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2375:x1873908059966208:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2051us (7860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098261.541072:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 293 00000100:00100000:3.0:1787098261.649969:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077771136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098261.650164:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098261.655399:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077771136 00000100:00100000:1.0:1787098261.655422:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077771136 00000100:00080000:0.0:1787098261.655587:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098261.655621:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787098261.655636:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077771136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787098261.655686:0:6705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098261.655803:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077771136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (5640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098261.655813:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787098261.657061:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787098261.657073:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7241b0df80, transno 4294967324 00000100:00100000:0.0:1787098261.657410:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077771136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787098261.906817:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787098262.185921:0:12890:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:11:00 (1787098260) 00010000:00010000:0.0:1787098262.927642:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098263.951939:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098264.207511:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077771520:0@lo:400:kworker.0 00000100:00100000:2.0:1787098264.207529:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077771648:0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.207583:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077771264:0@lo:400:kworker.0 00000100:00100000:2.0:1787098264.207680:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098264.207770:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098264.207953:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098264.208006:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077771776:0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.208032:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098264.208064:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787098264.208071:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077771392:0@lo:400:kworker.0 00000100:00100000:3.0:1787098264.208084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077771264 00000100:00100000:3.0:1787098264.208095:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077771264 00000100:00100000:0.0:1787098264.208101:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098264.208122:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077771904:0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.208148:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098264.208157:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787098264.208170:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077771264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.208191:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077771648 00000100:00100000:0.0:1787098264.208196:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077771648 00000100:00100000:3.0:1787098264.208240:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077771264:12345-0@lo:400:kworker.0 Request processed in 73us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098264.208248:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787098264.208398:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077771904 00000100:00100000:0.0:1787098264.208403:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077771904 00000100:00100000:0.0:1787098264.208435:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787098264.208444:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077771648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098264.208509:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077771520 00000100:00100000:2.0:1787098264.208514:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077771520 00000100:00100000:2.0:1787098264.208562:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077771776 00000100:00100000:2.0:1787098264.208566:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077771776 00000100:00100000:2.0:1787098264.208583:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077771392 00000100:00100000:2.0:1787098264.208585:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077771392 00000100:00100000:2.0:1787098264.208599:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787098264.208606:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077771520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.208645:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077771648:12345-0@lo:400:kworker.0 Request processed in 202us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098264.208654:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787098264.208672:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077771520:12345-0@lo:400:kworker.0 Request processed in 64us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098264.208675:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787098264.208689:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787098264.208689:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077771904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098264.208721:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787098264.208729:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077771776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098264.208761:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077771776:12345-0@lo:400:kworker.0 Request processed in 34us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098264.208767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787098264.208777:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787098264.208783:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077771392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098264.208823:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077771392:12345-0@lo:400:kworker.0 Request processed in 41us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098264.208830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787098264.208889:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077771520:0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.208899:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077771904:12345-0@lo:400:kworker.0 Request processed in 212us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098264.208907:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1787098264.208945:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787098264.208951:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787098264.208954:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098264.209215:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077771648:0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.209349:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077771392:0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.209363:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077771904:0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.209373:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077771264:0@lo:400:kworker.0 00000100:00100000:0.0:1787098264.209397:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077771776:0@lo:400:kworker.0 00000100:00100000:2.0:1787098264.719962:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077772032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098264.720072:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098264.724084:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077772032 00000100:00100000:1.0:1787098264.724111:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077772032 00000100:00100000:1.0:1787098264.724211:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787098264.724224:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077772032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098264.724314:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098264.724437:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077772032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 215us (4365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098264.724502:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077772032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787098264.724765:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:2.0:1787098264.975734:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787098265.615797:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787098265.615812:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787098265.616477:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787098265.616486:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787098265.976222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098265.980296:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059966976 00000100:00100000:1.0:1787098265.980316:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059966976 00000100:00080000:0.0:1787098265.980484:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098265.980537:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1787098265.980571:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+18:12365:x1873908059966976:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:1.0:1787098265.981390:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+19:12365:x1873908059966976:12345-192.168.204.51@tcp:35:umount.0 Request processed in 821us (5177us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787098265.981402:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:3.0:1787098265.983701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098265.984028:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059967232 00000100:00100000:2.0:1787098265.984042:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059967232 00000100:00100000:2.0:1787098265.984127:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:2.0:1787098265.984139:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+19:12365:x1873908059967232:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:2.0:1787098265.985389:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+20:12365:x1873908059967232:12345-192.168.204.51@tcp:35:umount.0 Request processed in 1240us (1691us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787098265.985423:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:0.0:1787098265.991604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098265.991831:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059967488 00000100:00100000:1.0:1787098265.991845:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059967488 00000100:00100000:1.0:1787098265.991921:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:1.0:1787098265.991934:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72325b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+20:12365:x1873908059967488:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:1.0:1787098265.993595:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72325b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+21:12365:x1873908059967488:12345-192.168.204.51@tcp:35:umount.0 Request processed in 1649us (1992us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787098265.994973:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00010000:00010000:0.0:1787098266.000625:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098266.007848:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098266.011243:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059967744 00000100:00100000:2.0:1787098266.011265:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059967744 00000100:00100000:2.0:1787098266.011381:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1787098266.011394:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+21:12365:x1873908059967744:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:2.0:1787098266.014207:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:530d6019-f48b-45e0-97e8-95fbd128e52b+22:12365:x1873908059967744:12345-192.168.204.51@tcp:35:umount.0 Request processed in 2801us (6361us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787098266.014225:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1787098266.017699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098266.017921:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059967872 00000100:00100000:1.0:1787098266.017937:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059967872 00000100:00100000:1.0:1787098266.018037:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1787098266.018050:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2376:x1873908059967872:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098266.018075:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098266.018104:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204e800/0xb1d871f9b01446e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873a7 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098266.018130:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098266.018209:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:2376:x1873908059967872:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 161us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098266.018218:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1787098266.031578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098266.031809:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098266.031933:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059968128 00000100:00100000:2.0:1787098266.031958:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059968128 00000100:00100000:2.0:1787098266.032052:0:11178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059968000 00000100:00100000:2.0:1787098266.032056:0:11178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059968000 00000100:00100000:2.0:1787098266.032094:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1787098266.032164:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7b54d1-1395-452b-8e33-1bd24f400ba4+13:2373:x1873908059968128:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098266.032190:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098266.032219:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c7200/0xb1d871f9b01448f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287472 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098266.032248:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098266.032392:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:2373:x1873908059968128:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 282us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098266.032402:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1787098266.032422:0:11178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1787098266.032429:0:11178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:2374:x1873908059968000:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098266.032440:0:11178:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098266.032465:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6c00/0xb1d871f9b0144646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528736f expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098266.032477:0:11178:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098266.032500:0:11178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2374:x1873908059968000:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 71us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098266.032518:0:11178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1787098266.039899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098266.039981:0:12017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059968256 00000100:00100000:2.0:1787098266.039997:0:12017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059968256 00000100:00100000:2.0:1787098266.040134:0:12017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:2.0:1787098266.040149:0:12017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+5:2372:x1873908059968256:12345-192.168.204.51@tcp:9:umount.0 00000020:00000080:2.0:1787098266.040192:0:12017:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01449b8 00000100:00080000:2.0:1787098266.040204:0:12017:0:(import.c:65:import_set_state_nolock()) ffff8d7227470000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787098266.040265:0:12017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1787098266.040332:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787098266.040564:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098266.040710:0:12017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:530d6019-f48b-45e0-97e8-95fbd128e52b+2:2372:x1873908059968256:12345-192.168.204.51@tcp:9:umount.0 Request processed in 563us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098266.040720:0:12017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:3.0:1787098266.046084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098266.046332:0:6860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059968640 00000100:00100000:0.0:1787098266.046345:0:6860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059968640 00000100:00100000:0.0:1787098266.046447:0:6860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1787098266.046459:0:6860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+7:2372:x1873908059968640:12345-192.168.204.51@tcp:9:umount.0 00000020:00000080:0.0:1787098266.046500:0:6860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144c19 00000020:00010000:0.0:1787098266.046519:0:6860:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d710499a800: total 0 00000100:00080000:0.0:1787098266.046525:0:6860:0:(import.c:65:import_set_state_nolock()) ffff8d723b44f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787098266.046584:0:6860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1787098266.046667:0:5832:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d710499a800: total 0 00010000:00010000:1.0:1787098266.046739:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d710499a800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787098266.046815:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035915df7/0xb1d871f9b0144fbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287647 expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098266.046855:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a4c1b54/0xb1d871f9b014565a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287815 expref: 5 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098266.046871:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d710499a800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787098266.046883:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098266.046886:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098266.046888:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098266.047152:0:6860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:530d6019-f48b-45e0-97e8-95fbd128e52b+2:2372:x1873908059968640:12345-192.168.204.51@tcp:9:umount.0 Request processed in 693us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098266.047162:0:6860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00080000:2.0:1787098266.048015:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098266.062490:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098266.062608:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059969664 00000100:00100000:2.0:1787098266.062641:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059969664 00000100:00100000:2.0:1787098266.062732:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 240 00000100:00100000:2.0:1787098266.062744:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+22:2372:x1873908059969664:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:2.0:1787098266.062805:0:5844:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144654 00000020:00010000:2.0:1787098266.062830:0:5844:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d723b572800: total 0 00000100:00080000:2.0:1787098266.062836:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8d723b573000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787098266.062870:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787098266.063379:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:530d6019-f48b-45e0-97e8-95fbd128e52b+21:2372:x1873908059969664:12345-192.168.204.51@tcp:39:umount.0 Request processed in 633us (899us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787098266.063412:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 240 00000020:00010000:0.0:1787098266.064032:0:6716:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d723b572800: total 0 00010000:00010000:0.0:1787098266.064093:0:6716:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d723b572800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787098266.064143:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098266.064148:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098266.064160:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413a00/0xb1d871f9b0144f7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287632 expref: 20 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064196:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098266.064199:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098266.064204:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b014561b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287800 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064219:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:0.0:1787098266.064222:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787098266.064226:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b014501e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287663 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064242:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d7208701300) 00010000:00010000:0.0:1787098266.064244:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098266.064248:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695a00/0xb1d871f9b014493a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287487 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064267:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d7203eadb00) 00010000:00010000:0.0:1787098266.064269:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787098266.064273:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623200/0xb1d871f9b014491e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287480 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064346:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098266.064348:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787098266.064353:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6400/0xb1d871f9b0144fa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287640 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064368:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098266.064371:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787098266.064383:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7200030600/0xb1d871f9b0145645 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528780e expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064399:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:0.0:1787098266.064402:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098266.064405:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413e00/0xb1d871f9b014553b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52877c8 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064421:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:0.0:1787098266.064423:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787098266.064427:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0144c7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528756e expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064438:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:0.0:1787098266.064441:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787098266.064445:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227623c00/0xb1d871f9b014503a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528766a expref: 11 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064456:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d7203ead200) 00010000:00010000:0.0:1787098266.064458:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787098266.064461:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145319 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528773c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064476:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d7208d7f600) 00010000:00010000:0.0:1787098266.064479:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787098266.064482:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412800/0xb1d871f9b014498e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528749c expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064499:0:6716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d7203ead400) 00010000:00010000:0.0:1787098266.064518:0:6716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787098266.064524:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695600/0xb1d871f9b0144e9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52875fa expref: 8 pid: 6853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098266.064538:0:6716:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d723b572800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787098266.064551:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098266.064554:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098266.064555:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098266.645331:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098266.645760:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059969792 00000100:00100000:0.0:1787098266.645775:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059969792 00000100:00100000:0.0:1787098266.645891:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00100000:0.0:1787098266.645905:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2375:x1873908059969792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098266.646205:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2375:x1873908059969792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 241us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098266.646217:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00080000:2.0:1787098266.646384:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098266.768576:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723b73df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077772160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098266.768752:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098266.768850:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077772160 00000100:00100000:3.0:1787098266.768861:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077772160 00000100:00080000:1.0:1787098266.769084:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787098266.769263:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787098266.769277:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077772160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787098266.769372:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098266.769444:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077772160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098266.769451:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787098266.769528:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723b73df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077772160:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787098266.865410:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:3.0:1787098266.865422:0:7660:0:(genops.c:906:class_export_put()) final put ffff8d7227475000/530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:1.0:1787098266.865510:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7227475000/530d6019-f48b-45e0-97e8-95fbd128e52b for lustre-OST0001 00000020:00000080:1.0:1787098266.865589:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7227470000 for lustre-OST0001 00010000:00010000:3.0:1787098267.025179:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098267.555836:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098267.555904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098267.555961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098267.556254:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059970048 00000100:00100000:0.0:1787098267.556268:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059970048 00000100:00100000:0.0:1787098267.556389:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059969920 00000100:00100000:0.0:1787098267.556393:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059969920 00000100:00100000:0.0:1787098267.556416:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059970176 00000100:00100000:0.0:1787098267.556420:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059970176 00000100:00100000:0.0:1787098267.556440:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1787098267.556450:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+12:2373:x1873908059970048:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098267.556472:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098267.556513:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208694000/0xb1d871f9b014472d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873e6 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098267.556536:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00010000:00010000:0.0:1787098267.556547:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098267.556550:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7208e32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+11:2373:x1873908059969920:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098267.556562:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098267.556575:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c7800/0xb1d871f9b0144726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873bc expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098267.556593:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098267.556643:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+10:2373:x1873908059970048:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 193us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098267.556652:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1787098267.556674:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:0.0:1787098267.556681:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+9:2373:x1873908059970176:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098267.556690:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098267.556700:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208694600/0xb1d871f9b01448ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528746b expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098267.556710:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098267.557367:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7208e32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7b54d1-1395-452b-8e33-1bd24f400ba4+8:2373:x1873908059969920:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 815us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098267.557378:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1787098267.559867:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+7:2373:x1873908059970176:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 3167us (3897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098267.559884:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:3.0:1787098267.562064:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098267.562156:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059970432 00000100:00100000:2.0:1787098267.562178:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059970432 00000100:00100000:2.0:1787098267.562335:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:2.0:1787098267.562351:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+6:2372:x1873908059970432:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:2.0:1787098267.562417:0:5844:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b014473b 00000020:00010000:2.0:1787098267.562430:0:5844:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d723b44e800: total 0 00000100:00080000:2.0:1787098267.562436:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8d723b44b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787098267.562472:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1787098267.562685:0:5832:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d723b44e800: total 0 00010000:00010000:3.0:1787098267.562690:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098267.562752:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d723b44e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787098267.562794:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7207e92d00) 00010000:00010000:3.0:1787098267.562798:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098267.562810:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7208695000/0xb1d871f9b0145668 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528781c expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098267.562842:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d723b44e800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787098267.562854:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098267.562856:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098267.562858:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098267.566155:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1944369d-673b-48ef-ae48-bb74d2b5ab81+3:2372:x1873908059970432:12345-192.168.204.51@tcp:39:umount.0 Request processed in 3790us (4083us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787098267.566179:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:3.0:1787098267.589839:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098267.591510:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059970688 00000100:00100000:1.0:1787098267.591528:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059970688 00000100:00100000:1.0:1787098267.591627:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 295 00000100:00100000:1.0:1787098267.591640:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+7:2372:x1873908059970688:12345-192.168.204.51@tcp:251:umount.0 00000020:00000080:1.0:1787098267.591711:0:5838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144631 00000020:00010000:1.0:1787098267.591721:0:5838:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d7241aaa000: total 0 00000100:00080000:1.0:1787098267.591726:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8d7241aae000 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787098267.591797:0:6716:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d7241aaa000: total 0 00010000:00010000:0.0:1787098267.591858:0:6716:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d7241aaa000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787098267.591902:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208694200/0xb1d871f9b01446e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52873ae expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098267.591923:0:6716:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d7241aaa000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787098267.591933:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098267.591936:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098267.591938:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098267.592660:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72048ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f7b54d1-1395-452b-8e33-1bd24f400ba4+1:2372:x1873908059970688:12345-192.168.204.51@tcp:251:umount.0 Request processed in 1019us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098267.592693:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 295 00000020:00000080:1.0:1787098267.592708:0:5838:0:(genops.c:906:class_export_put()) final put ffff8d7241aaa000/4f7b54d1-1395-452b-8e33-1bd24f400ba4 00000020:00000080:0.0:1787098267.594823:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7241aaa000/4f7b54d1-1395-452b-8e33-1bd24f400ba4 for MGS 00000020:00000080:0.0:1787098267.594893:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7241aae000 for MGS 00010000:00010000:3.0:1787098268.048324:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787098269.035577:0:13089:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787098269.059595:0:13089:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787098269.059649:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.059666:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.060342:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.060356:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.060381:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787098269.060387:0:13089:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787098269.060421:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787098269.060425:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1787098269.060426:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1787098269.060431:0:13089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1787098269.060436:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.060446:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204ec00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098269.060464:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787098269.060468:0:13089:0:(import.c:65:import_set_state_nolock()) ffff8d72403bb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787098269.060477:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098269.060486:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098269.060492:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787098269.060495:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787098269.060497:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787098269.060524:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.060530:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098269.060558:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.060572:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204ec00/0xb1d871f9b01446b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.060589:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098269.060605:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098269.060607:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098269.060779:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077772288:0@lo:39:umount.0 00000100:00100000:0.0:1787098269.060862:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098269.061185:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077772416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098269.061222:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098269.061644:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077772288 00000100:00100000:2.0:1787098269.061654:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077772288 00000100:00100000:1.0:1787098269.061670:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077772416 00000100:00100000:1.0:1787098269.061677:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077772416 00000100:00100000:2.0:1787098269.061843:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787098269.061852:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873908077772288:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787098269.061887:0:5843:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b014444e 00000100:00100000:1.0:1787098269.061889:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787098269.061897:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d72403bc000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787098269.061903:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3311:x1873908077772416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787098269.061916:0:11681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098269.061932:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f090800/0xb1d871f9b01446bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b01446b6 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.061950:0:11681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098269.061965:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3308:x1873908077772288:12345-0@lo:39:umount.0 Request processed in 112us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098269.061975:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787098269.061986:0:5843:0:(genops.c:906:class_export_put()) final put ffff8d72403bb000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1787098269.061995:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:3311:x1873908077772416:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098269.062004:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:2.0:1787098269.062016:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72403bb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1787098269.062073:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787098269.062106:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d72403bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787098269.062128:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077772288:0@lo:39:umount.0 00000020:00000080:2.0:1787098269.062191:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d72403bc000 for lustre-MDT0000 00000100:00080000:2.0:1787098269.062761:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787098269.062772:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787098269.062776:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787098269.063322:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077772416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098269.064189:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064203:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064210:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064216:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064240:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098269.064247:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064253:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064258:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064264:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.064333:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098269.064342:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.064352:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694a00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098269.064355:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064445:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098269.064465:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064484:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.064484:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098269.064489:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064491:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.064497:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7400 already unused, calling callback (ffffffffc1d1dc20) 00010000:00010000:2.0:1787098269.064498:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098269.064500:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.064508:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098269.064514:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064517:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098269.064522:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064528:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098269.064530:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787098269.064533:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787098269.064534:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098269.064535:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787098269.064539:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098269.064545:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787098269.064547:0:13089:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1787098269.064567:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787098269.064570:0:13089:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:1.0:1787098269.064572:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000000:2.0:1787098269.064574:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787098269.064578:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098269.064583:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1787098269.064589:0:13089:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d7241aab000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1787098269.064593:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787098269.064599:0:13089:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8d7104d91800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1787098269.064600:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d72421c7400/0xb1d871f9b01445eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01445f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787098269.064606:0:13089:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8d723b44e800 1944369d-673b-48ef-ae48-bb74d2b5ab81 192.168.204.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787098269.064610:0:13089:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8d723b572800 530d6019-f48b-45e0-97e8-95fbd128e52b 192.168.204.51@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:2.0:1787098269.064616:0:13089:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8d723badcd40) has exports, disconnecting them 00010000:00010000:1.0:1787098269.064617:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:2.0:1787098269.064619:0:13089:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d7241aab000), last request at 1787098264 00010000:00010000:1.0:1787098269.064620:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787098269.064625:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01445b3 00010000:00010000:1.0:1787098269.064625:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694e00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:1.0:1787098269.064628:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787098269.064638:0:13089:0:(import.c:65:import_set_state_nolock()) ffff8d7241aac000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787098269.064644:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.064647:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787098269.064650:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098269.064663:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098269.064663:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787098269.064667:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787098269.064670:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787098269.064675:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787098269.064677:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787098269.064679:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787098269.064697:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.064703:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098269.064723:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.064729:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7208694a00/0xb1d871f9b01446c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446cb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.064740:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098269.064743:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.064748:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f091e00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098269.064751:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.064756:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098269.064773:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098269.064778:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787098269.064780:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787098269.064782:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:2.0:1787098269.064792:0:13089:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7241aab000): rc 0 00000020:00000080:2.0:1787098269.064796:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d7241aab000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1787098269.064798:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.064805:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1787098269.064807:0:13089:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d7104d91800), last request at 1787098264 00000020:00000080:2.0:1787098269.064814:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01444e8 00010000:00010000:3.0:1787098269.064815:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787098269.064822:0:13089:0:(import.c:65:import_set_state_nolock()) ffff8d7104d95000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787098269.064824:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d720f091e00/0xb1d871f9b014439f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01443a6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787098269.064832:0:13089:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7104d91800): rc 0 00000020:00000080:2.0:1787098269.064836:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d7104d91800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1787098269.064843:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1787098269.064844:0:13089:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa82383f07ae0 00010000:00010000:3.0:1787098269.064848:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098269.064851:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098269.064869:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077772672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098269.064939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098269.064995:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098269.065001:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077772800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098269.065024:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098269.065062:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077772672 00000100:00100000:3.0:1787098269.065069:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077772672 00000100:00100000:3.0:1787098269.065109:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077772800 00000100:00100000:3.0:1787098269.065112:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077772800 00000100:00100000:3.0:1787098269.065134:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787098269.065150:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+19:3309:x1873908077772672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787098269.065163:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098269.065177:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227412a00/0xb1d871f9b01446cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b01446c4 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.065189:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098269.065222:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+18:3309:x1873908077772672:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098269.065228:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787098269.065246:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787098269.065251:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787098269.065254:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:3309:x1873908077772800:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787098269.065256:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:3.0:1787098269.065266:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:2.0:1787098269.065270:0:13089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1787098269.065311:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200031a00/0xb1d871f9b01443a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b014439f expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.065325:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098269.065349:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3309:x1873908077772800:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098269.065356:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787098269.065407:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077772800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098269.065416:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077772672:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787098269.065435:0:13089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787098269.065462:0:13089:0:(import.c:65:import_set_state_nolock()) ffff8d724028d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787098269.065486:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787098269.065488:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787098269.065496:0:13089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787098269.065558:0:13089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787098269.065567:0:13089:0:(import.c:65:import_set_state_nolock()) ffff8d7240289800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787098269.065601:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077772928:0@lo:9:umount.0 00000020:00080000:2.0:1787098269.065604:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8d723badcd40) has no exports 00000100:00100000:3.0:1787098269.065634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098269.065665:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077773056:0@lo:9:umount.0 00000100:00100000:3.0:1787098269.065687:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098269.065731:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077772928 00000100:00100000:3.0:1787098269.065737:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077772928 00000100:00100000:2.0:1787098269.065757:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077773056 00000100:00100000:2.0:1787098269.065769:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077773056 00000100:00100000:3.0:1787098269.065783:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787098269.065793:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873908077772928:12345-0@lo:9:umount.0 00000100:00100000:2.0:1787098269.065808:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000020:00000080:3.0:1787098269.065816:0:6701:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144535 00000100:00100000:2.0:1787098269.065821:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873908077773056:12345-0@lo:9:umount.0 00000100:00080000:3.0:1787098269.065827:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8d72416b9800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787098269.065839:0:6702:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b014461c 00000100:00080000:2.0:1787098269.065847:0:6702:0:(import.c:65:import_set_state_nolock()) ffff8d723b577800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787098269.065865:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787098269.066042:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3308:x1873908077772928:12345-0@lo:9:umount.0 Request processed in 251us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098269.066049:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787098269.066068:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787098269.066071:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787098269.066081:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787098269.066100:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d724028d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787098269.066104:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787098269.066106:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787098269.066109:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077772928:0@lo:9:umount.0 00010000:00010000:1.0:1787098269.066175:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.066184:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787098269.066195:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.066203:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7208694e00/0xb1d871f9b01448df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01448e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098269.066213:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098269.066215:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098269.066217:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787098269.066275:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7241aab000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1787098269.066320:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077773184:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1787098269.066348:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7104d91800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1787098269.066351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787098269.066376:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7241aac000 for lustre-MDT0000 00000020:00000080:0.0:1787098269.066381:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7104d95000 for lustre-MDT0000 00000100:00100000:0.0:1787098269.066400:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077772544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787098269.066432:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1787098269.066483:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1787098269.066483:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098269.066545:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077773184 00000100:00100000:3.0:1787098269.066550:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077773184 00000100:00100000:3.0:1787098269.066594:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077772544 00000100:00100000:3.0:1787098269.066598:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077772544 00000100:00100000:3.0:1787098269.066629:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787098269.066637:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+17:3311:x1873908077773184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787098269.066645:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098269.066658:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6800/0xb1d871f9b01448e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b01448df expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098269.066672:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098269.066698:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+16:3311:x1873908077773184:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098269.066713:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787098269.066728:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787098269.066734:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+15:3312:x1873908077772544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787098269.066741:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098269.066756:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200030000/0xb1d871f9b01445f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b01445eb expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098269.066765:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077773184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787098269.066770:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098269.066802:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b73df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af6522d0-d61c-40bd-bd34-bb282ba82d15+14:3312:x1873908077772544:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098269.066808:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787098269.067010:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3308:x1873908077773056:12345-0@lo:9:umount.0 Request processed in 1193us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098269.067018:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787098269.069483:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af6522d0-d61c-40bd-bd34-bb282ba82d15:3312:1873908077772544:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787098269.070728:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7240289800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787098269.070747:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787098269.070751:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787098269.070757:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077773056:0@lo:9:umount.0 00010000:00010000:2.0:1787098269.074703:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787098269.084696:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8d723badcd40) has no exports 00000020:00000080:0.0:1787098269.141267:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01443fa 00000020:00000080:0.0:1787098269.141528:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d72068d8000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787098269.141549:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787098269.141641:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72068d8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787098269.141730:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787098269.141742:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787098269.141747:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8d723bad99c0) has no exports 00000020:00000080:1.0:1787098269.142102:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01443f3 00000020:00000080:1.0:1787098269.142108:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d720fc9f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787098269.142169:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d720fc9f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787098269.142238:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787098269.142245:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787098269.142248:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d723baf1000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787098269.142250:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723baf1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787098269.142259:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:3.0:1787098269.327602:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787098269.327626:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077773440:0@lo:400:kworker.0 00000100:00100000:0.0:1787098269.327626:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077773312:0@lo:400:kworker.0 00000100:00100000:0.0:1787098269.329983:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098269.333052:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077773312 00000100:00100000:1.0:1787098269.333067:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077773312 00000100:00100000:1.0:1787098269.333201:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787098269.333211:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1873908077773312:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787098269.333236:0:5845:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787098269.333334:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1873908077773312:12345-0@lo:400:kworker.0 Request processed in 123us (3360us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787098269.333341:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1787098269.333763:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787098269.333769:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8d7104c20000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787098269.333772:0:3312:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787098269.334857:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098269.339794:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077773440 00000100:00100000:2.0:1787098269.339812:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077773440 00000100:00100000:2.0:1787098269.339866:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787098269.339874:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873908077773440:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787098269.339884:0:5843:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787098269.339972:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1873908077773440:12345-0@lo:400:kworker.0 Request processed in 97us (5118us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787098269.339980:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1787098269.340092:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787098269.340098:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d7241aaf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787098269.340102:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787098269.340108:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8d7241aaf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787098269.340112:0:3310:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 194 00000100:00080000:3.0:1787098269.340120:0:3310:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d7241aaf800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1787098269.340154:0:3310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7241a80380 x1873908077773568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787098269.340209:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077773440:0@lo:400:kworker.0 00000100:00100000:2.0:1787098269.340668:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1873908077773568:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787098269.341201:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098269.346259:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077773568 00000100:00100000:1.0:1787098269.346272:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077773568 00000100:00100000:1.0:1787098269.346334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787098269.346342:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1873908077773568:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1787098269.346362:0:5845:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1787098269.347493:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8d7104c20000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787098269.347505:0:3312:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 178 00000100:00080000:0.0:1787098269.347513:0:3312:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d7104c20000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1787098269.347550:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723ba01c00 x1873908077773696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787098269.347622:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1873908077773696:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787098269.347694:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098269.347766:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077773312:0@lo:400:kworker.0 00000100:00100000:3.0:1787098269.347990:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077773696 00000100:00100000:3.0:1787098269.347997:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077773696 00000100:00100000:3.0:1787098269.348030:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787098269.348038:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1873908077773696:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1787098269.348053:0:5843:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1787098269.350066:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7104c20000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787098269.350073:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787098269.350077:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1873908077773696:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787098269.350552:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1873908077773696:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 1922us (2266us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787098269.350565:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787098269.357232:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1873908077773568:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 10880us (16023us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787098269.357246:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1787098269.357367:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7241aaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787098269.357374:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787098269.357377:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1873908077773568:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1787098270.096924:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787098270.920268:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:2.0:1787098270.920299:0:6727:0:(genops.c:906:class_export_put()) final put ffff8d710499a800/530d6019-f48b-45e0-97e8-95fbd128e52b 00000001:00100000:2.0:1787098270.920332:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787098270.920335:0:6727:0:(genops.c:906:class_export_put()) final put ffff8d72416bd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787098270.920360:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d710499a800/530d6019-f48b-45e0-97e8-95fbd128e52b for lustre-OST0000 00000020:00000080:2.0:1787098270.920431:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72416bd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787098270.920453:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d723b44f000 for lustre-OST0000 00000020:00000080:2.0:1787098270.920459:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d72416b9800 for lustre-OST0000 00000001:00080000:0.0:1787098270.941423:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:0.0:1787098270.941460:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1944369d-673b-48ef-ae48-bb74d2b5ab81 00000001:00080000:0.0:1787098270.941468:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787098270.941473:0:5866:0:(genops.c:906:class_export_put()) final put ffff8d723b44e800/1944369d-673b-48ef-ae48-bb74d2b5ab81 00000001:00100000:0.0:1787098270.941795:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 530d6019-f48b-45e0-97e8-95fbd128e52b 00000001:00080000:0.0:1787098270.941801:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1787098270.941809:0:5866:0:(genops.c:906:class_export_put()) final put ffff8d723b572800/530d6019-f48b-45e0-97e8-95fbd128e52b 00000020:00000080:3.0:1787098270.941991:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723b44e800/1944369d-673b-48ef-ae48-bb74d2b5ab81 for lustre-MDT0000 00000020:00000080:3.0:1787098270.942101:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d723b44b800 for lustre-MDT0000 00000020:00000080:3.0:1787098270.942217:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723b572800/530d6019-f48b-45e0-97e8-95fbd128e52b for lustre-MDT0000 00000020:00000080:3.0:1787098270.942262:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d723b573000 for lustre-MDT0000 00010000:00010000:0.0:1787098271.119860:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787098271.184005:0:13089:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d7206692180 - data ffff8d721c049288/ffff8d7241a98000 00000020:01000000:1.0:1787098271.184218:0:13089:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d720a229360 - data ffff8d721ddd20d8/ffff8d723d4e6c00 00000001:00000004:1.0:1787098271.193905:0:13089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787098271.254958:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787098271.254968:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787098271.254994:0:13089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787098271.254997:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787098271.256311:0:6851:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787098271.256317:0:6851:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1787098271.256335:0:6851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787098271.262787:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787098271.262797:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787098271.262813:0:13089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787098271.262816:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787098271.263193:0:8141:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787098271.263202:0:8141:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787098271.263212:0:8141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787098271.342018:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01443c2 00000020:00000080:2.0:1787098271.342031:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d7203f99800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787098271.342725:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7203f99800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787098271.348247:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01443d7 00000020:00000080:2.0:1787098271.348264:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d723baf5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787098271.349258:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787098271.349270:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098271.349317:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787098271.349323:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8d723badb380) has no exports 00000004:01000000:2.0:1787098271.349544:0:13089:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787098271.349553:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144615 00000020:00000080:2.0:1787098271.349559:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d723b44e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787098271.349564:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787098271.349568:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098271.349574:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787098271.349576:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8d7241928000) has no exports 00000020:00000080:2.0:1787098271.349583:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b014460e 00000020:00000080:2.0:1787098271.349586:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d724028f000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787098271.349709:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723baf5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787098271.349722:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723b44e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787098271.349748:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d724028f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787098271.350155:0:13089:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787098271.350161:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787098271.350165:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787098271.350171:0:13089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787098271.350174:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787098271.350241:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787098271.350248:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787098271.350253:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b014452e 00000020:00000080:2.0:1787098271.350258:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d72416b8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787098271.350263:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787098271.350266:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098271.350270:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:3.0:1787098271.350272:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7240289800 for lustre-OST0001-osc-MDT0000 00000020:00080000:2.0:1787098271.350274:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8d720655b380) has no exports 00000020:00000080:2.0:1787098271.350299:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144527 00000020:00000080:3.0:1787098271.350300:0:8:0:(genops.c:906:class_export_put()) final put ffff8d723b449000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787098271.350305:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723b449000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787098271.350306:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d7240288000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787098271.350317:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787098271.350703:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72416b8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787098271.350716:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7240288000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787098271.350972:0:13089:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787098271.350976:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787098271.350979:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787098271.352558:0:13089:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787098271.352562:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787098271.352641:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d724028d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787098271.352653:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787098271.352885:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787098271.352892:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d723f2e4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787098271.352896:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723f2e4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787098271.352909:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787098271.353155:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787098271.353161:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787098271.353164:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d7208c35800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787098271.353167:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7208c35800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787098271.353172:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787098271.353622:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01443de 00000020:00000080:2.0:1787098271.353862:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d723baf0000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787098271.353886:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787098271.353894:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098271.353902:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787098271.353911:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8d723bad8000) has no exports 00000020:00000080:2.0:1787098271.353957:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787098271.353964:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787098271.353969:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01443e5 00000020:00000080:2.0:1787098271.353977:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d723baf6000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787098271.353989:0:13089:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d72079cb000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787098271.353992:0:13089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d72079cb000 3 00000020:01000004:2.0:1787098271.353996:0:13089:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d72079cb000 from lustre-MDT0000 00000020:00000080:2.0:1787098271.354033:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787098271.354039:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787098271.354043:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d7203f9d000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787098271.354047:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7203f9d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787098271.354057:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1787098271.354181:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723baf0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787098271.354187:0:8:0:(genops.c:906:class_export_put()) final put ffff8d7203b20800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787098271.354191:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7203b20800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787098271.354198:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1787098271.354559:0:13089:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787098271.354564:0:13089:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787098271.354567:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787098271.354571:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098271.354575:0:13089:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787098271.354581:0:13089:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8d7203f80800 af6522d0-d61c-40bd-bd34-bb282ba82d15 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787098271.354586:0:13089:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8d72065e99c0) has exports, disconnecting them 00000020:00080000:2.0:1787098271.354591:0:13089:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d7203f80800), last request at 1787098060 00000020:00000080:2.0:1787098271.354608:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144383 00000020:00010000:2.0:1787098271.354612:0:13089:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8d7203f80800: total 2 00000100:00080000:2.0:1787098271.354617:0:13089:0:(import.c:65:import_set_state_nolock()) ffff8d7203f83800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787098271.355001:0:13089:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7203f80800): rc 0 00000020:00080000:2.0:1787098271.355009:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8d72065e99c0) has no exports 00000020:00010000:0.0:1787098271.355093:0:5833:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8d7203f80800: total 2 00010000:00010000:0.0:1787098271.355167:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d7203f80800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787098271.355222:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227622000/0xb1d871f9b01448d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b01448d1 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098271.355259:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208695c00/0xb1d871f9b01448ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b01448c3 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787098271.355270:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723baf6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787098271.355345:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208694800/0xb1d871f9b01446d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b01446d2 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098271.355363:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204f400/0xb1d871f9b014449b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b0144494 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098271.355398:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0144685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b014467e expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098271.355421:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f091a00/0xb1d871f9b0144693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b014468c expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098271.355433:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b01446af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b01446a8 expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098271.355446:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d720f090200/0xb1d871f9b01446a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb1d871f9b014469a expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098271.355457:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d7203f80800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787098271.355473:0:5833:0:(genops.c:906:class_export_put()) final put ffff8d7203f80800/af6522d0-d61c-40bd-bd34-bb282ba82d15 00010000:00010000:0.0:1787098271.355482:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098271.355485:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098271.355487:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098271.355641:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d72049c2c00:5838] 1 exiting: rc = 0 00000100:00100000:3.0:1787098271.355909:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d72048c8a00:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1787098271.356211:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d72048c9400:5839] 2 exiting: rc = 0 00000020:00000080:3.0:1787098271.356390:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7203f80800/af6522d0-d61c-40bd-bd34-bb282ba82d15 for MGS 00000020:00000080:3.0:1787098271.356445:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7203f83800 for MGS 00000100:00100000:2.0:1787098271.360718:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360733:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360743:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360752:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360762:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360775:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360786:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360810:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360815:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360820:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360826:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360832:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360839:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360845:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360851:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360857:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360863:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360868:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360874:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360879:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360884:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360892:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360898:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360904:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360912:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360917:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.360922:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362046:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362164:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362174:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362188:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362209:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362215:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362221:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362226:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362231:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362236:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362241:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362246:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362251:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362256:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362261:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362485:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362494:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362505:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362730:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362742:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362750:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362758:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362769:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362777:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362787:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362796:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362805:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362816:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362828:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362837:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362847:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362856:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362868:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362882:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362892:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362901:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.362910:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787098271.366080:0:13089:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787098271.366093:0:13089:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787098271.368623:0:13089:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d720fd9a9c0 - data ffff8d723973d438/ffff8d7241a6ac00 00000020:01000000:3.0:1787098271.369136:0:13089:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d72091c0de0 - data ffff8d72021391b0/ffff8d72064ee400 00000020:00000080:3.0:1787098271.370722:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144367 00000020:00000080:3.0:1787098271.370733:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d72078d3000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787098271.370801:0:13089:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d72079cb000 from MGS, refs=2 00000020:01000004:3.0:1787098271.370806:0:13089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d72079cb000 2 00000020:01000004:3.0:1787098271.370809:0:13089:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d72079cb000 from MGS 00000020:00000080:3.0:1787098271.370835:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787098271.370843:0:13089:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787098271.370846:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d72078d1800/MGS 00000020:00000080:3.0:1787098271.370864:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72078d1800/MGS for MGS 00000020:01000000:3.0:1787098271.370874:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787098271.370948:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787098271.370954:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787098271.370963:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787098271.370973:0:13089:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d72403bf800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787098271.370979:0:13089:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8d724192cd40) has exports, disconnecting them 00000020:00080000:3.0:1787098271.370986:0:13089:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d72403bf800), last request at 1787098061 00000020:00000080:3.0:1787098271.370991:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144432 00000020:00080000:3.0:1787098271.371019:0:13089:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d72403bf800): rc 0 00000020:00000080:3.0:1787098271.371027:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d72403bf800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787098271.371401:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72078d3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787098271.371488:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72403bf800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787098271.375139:0:13089:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787098271.375148:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787098271.375152:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787098271.375158:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787098271.375338:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787098271.375346:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787098271.375354:0:13089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d72079cb000 1 00000020:00000080:2.0:1787098271.375360:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144359 00000020:00000080:2.0:1787098271.375369:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d72078d3800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787098271.375374:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787098271.375379:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098271.375391:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787098271.375395:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8d7208e13380) has no exports 00000020:00000080:0.0:1787098271.375572:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d72403bb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787098271.375579:0:8:0:(genops.c:906:class_export_put()) final put ffff8d72403b9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787098271.375582:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72403b9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787098271.375592:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787098271.375678:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72078d3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787098271.416010:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787098271.416026:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787098271.416031:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d72086cc000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787098271.416036:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72086cc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787098271.416049:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787098271.416182:0:13089:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d72079c8800 00000020:01000000:2.0:1787098271.416203:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787098271.416207:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098271.416211:0:13089:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787098271.416215:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8d7208e10000) has no exports 00000100:00100000:2.0:1787098271.416331:0:6853:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d7104c8a600:6853] 3 exiting: rc = 0 00000100:00100000:3.0:1787098271.416498:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d7209384c00:5844] 1 exiting: rc = 0 00000100:00100000:3.0:1787098271.416575:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d7209384200:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1787098271.416814:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d720741f600:5845] 2 exiting: rc = 0 00000100:00100000:2.0:1787098271.417604:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417612:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417617:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417623:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417628:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417633:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417638:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417643:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417649:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417655:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417661:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417667:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417673:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417678:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417684:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417690:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417696:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417702:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417707:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417712:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417716:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417737:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417744:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417749:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417753:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417758:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417764:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417779:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417786:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417791:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417797:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417802:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417807:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417811:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417816:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417822:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417828:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417834:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417839:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417844:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417849:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417854:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417860:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417866:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417871:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417876:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417881:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417886:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417891:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417896:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417902:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417906:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417912:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417917:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417923:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417927:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417939:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417943:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417949:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417971:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417977:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417983:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417988:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.417995:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.424026:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d72049fae00:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1787098271.424248:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d720a4fe200:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1787098271.424504:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424513:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424520:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424526:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424532:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424548:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424555:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424561:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424566:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424573:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424578:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424584:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424591:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424596:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424601:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424606:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424611:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424621:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424626:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424631:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424637:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424641:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424647:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424652:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424657:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424662:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424668:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424688:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424694:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424699:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424704:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424709:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424713:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424718:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424724:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424728:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424733:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424738:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424743:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424749:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424754:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424759:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424764:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424769:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424774:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424778:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424784:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424789:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424794:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424801:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424806:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424811:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424817:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424822:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424828:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424834:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424839:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424843:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424849:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424854:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424859:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424864:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424878:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.424884:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.425376:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d72049fbc00:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1787098271.425632:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d72049fbe00:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1787098271.425943:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.425960:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.425978:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.425986:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.425992:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.425999:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426005:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426012:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426018:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426025:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426031:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426037:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426045:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426050:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426070:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426077:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426084:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426091:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426098:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426105:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426112:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426120:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426127:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426133:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426139:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426145:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426164:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426172:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426178:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426183:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426191:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426196:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426203:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426219:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426225:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426231:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426237:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426244:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426263:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426270:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426277:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426384:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426391:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426397:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426414:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426423:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426430:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426437:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426444:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426574:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426598:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426605:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426611:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426617:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426624:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426630:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426635:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426642:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426648:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426654:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426660:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426667:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426686:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098271.426693:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.437351:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d720a4ffa00:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1787098271.437382:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d7204980600:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1787098271.437688:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437696:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437701:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437707:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437714:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437718:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437724:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437729:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437734:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437739:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437758:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437763:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437768:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437773:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437778:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437783:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437788:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437794:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437799:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437805:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437810:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437816:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437821:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437827:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437831:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437836:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437842:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437846:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437850:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437855:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437860:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437865:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437870:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437875:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437881:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437886:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437892:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437897:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437902:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437907:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437912:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437917:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437922:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437934:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437940:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437952:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437957:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437962:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437968:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437973:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437978:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437984:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437989:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437994:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.437999:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.438004:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.438010:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.438015:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.438020:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.438026:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.438031:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.438036:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.438041:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098271.438047:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787098271.439030:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d7207404200:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1787098271.439701:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d7207405e00:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1787098271.439880:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439887:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439905:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439909:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439914:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439919:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439924:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439929:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439934:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439939:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439943:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439948:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439953:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439958:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439963:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439968:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439974:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439979:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439984:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439988:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439993:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.439999:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440005:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440010:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440015:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440021:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440026:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440032:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440037:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440042:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440047:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440052:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440057:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440061:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440067:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440072:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440076:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440088:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440093:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440098:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440103:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440108:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440113:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440118:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440123:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440127:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440131:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440136:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440141:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440147:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440151:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440156:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440162:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440167:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440173:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440178:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440183:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440188:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440193:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440198:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440204:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440209:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440214:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.440218:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787098271.443726:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d7207404a00:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1787098271.443947:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d7207405200:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1787098271.444120:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444128:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444134:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444140:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444145:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444151:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444158:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444163:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444183:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444188:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444194:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444199:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444205:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444210:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444216:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444220:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444225:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444231:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444237:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444242:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444247:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444252:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444257:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444261:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444266:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444270:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444275:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444729:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444736:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444742:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444747:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444754:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444760:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444765:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444770:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444776:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444781:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444786:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444792:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444797:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444802:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444808:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444813:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444826:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444832:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444837:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444842:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444847:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444852:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444857:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444862:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444867:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444872:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444878:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444883:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444888:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444893:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444898:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444904:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444909:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444914:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444919:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444924:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.444929:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787098271.445995:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d720789f600:5856] 0 exiting: rc = 1 00000100:00100000:0.0:1787098271.446208:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d72049c3a00:5858] 2 exiting: rc = 0 00000100:00100000:1.0:1787098271.446900:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d72049c2e00:5857] 1 exiting: rc = 0 00000100:00100000:0.0:1787098271.447010:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447018:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447023:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447030:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447045:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447064:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447072:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447078:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447084:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447090:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447096:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447103:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447123:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447141:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447148:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447154:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447160:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447165:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447172:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447177:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447183:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447192:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447200:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447206:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447211:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447217:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447223:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447228:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447234:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447258:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447265:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447271:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447276:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447314:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447320:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447325:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447331:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447336:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447342:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447347:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447353:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447358:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447363:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447369:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447375:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447381:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447386:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447391:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447416:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447422:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447427:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447433:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447439:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447459:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447467:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447472:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447478:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447494:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447499:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447505:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447510:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447515:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447521:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098271.447534:0:13089:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787098271.451791:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787098271.451805:0:13089:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787098271.451812:0:13089:0:(genops.c:906:class_export_put()) final put ffff8d7203f9e800/MDS_uuid 00000020:00000080:1.0:1787098271.451816:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7203f9e800/MDS_uuid for MDS 00000020:01000000:1.0:1787098271.451821:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787098271.451959:0:13089:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:3.0:1787098271.977734:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787098271.977744:0:7660:0:(genops.c:906:class_export_put()) final put ffff8d7104d92800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787098271.977804:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7104d92800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787098271.977851:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d723b577800 for lustre-OST0001 00010000:00010000:2.0:1787098272.143423:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098273.170828:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787098274.068255:0:13241:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787098274.078488:0:13241:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787098274.078538:0:13241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.078556:0:13241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.078563:0:13241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.078570:0:13241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.078592:0:13241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787098274.078598:0:13241:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787098274.078629:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787098274.078633:0:13241:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787098274.078639:0:13241:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787098274.078645:0:13241:0:(import.c:65:import_set_state_nolock()) ffff8d7104c20000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787098274.078650:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787098274.078652:0:13241:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787098274.078655:0:13241:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787098274.078708:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098274.078716:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098274.078725:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e200 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:0.0:1787098274.078729:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098274.078738:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787098274.078745:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098274.078751:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787098274.078753:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787098274.078769:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787098274.078808:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098274.078815:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787098274.078843:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098274.078851:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204e200/0xb1d871f9b014469a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446a1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098274.078863:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098274.078864:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098274.078866:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098274.078875:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098274.078892:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077773824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787098274.078961:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098274.079031:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077773824 00000100:00100000:0.0:1787098274.079038:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077773824 00000100:00100000:0.0:1787098274.079072:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787098274.079079:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7208e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1873908077773824:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787098274.079086:0:5830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787098274 with bad export cookie 12815118056897659779 00010000:00010000:2.0:1787098274.079558:0:13241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.079569:0:13241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.079576:0:13241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.079596:0:13241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.079619:0:13241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098274.079627:0:13241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.079634:0:13241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.079640:0:13241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.079647:0:13241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098274.079661:0:13241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787098274.079665:0:13241:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787098274.079683:0:13241:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787098274.079688:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787098274.079693:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098274.079699:0:13241:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787098274.079703:0:13241:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8d72065eb380) has no exports 00000020:00080000:2.0:1787098274.079733:0:13241:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8d72065eb380) has no exports 00010000:00010000:3.0:1787098274.082449:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098274.082463:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082477:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204f000 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098274.082481:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082492:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098274.082499:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098274.082524:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787098274.082528:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787098274.082532:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787098274.082583:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082590:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098274.082642:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082650:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b01446a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01446af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082667:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098274.082671:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082677:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695400 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098274.082679:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082687:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098274.082693:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098274.082699:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787098274.082701:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787098274.082703:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787098274.082727:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082733:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098274.082740:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082747:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01448d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb1d871f9b01448d8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098274.082757:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098274.082759:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098274.082760:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098274.082781:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077773952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098274.082848:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098274.082899:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787098274.082905:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077774080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098274.082926:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098274.082956:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077773952 00000100:00100000:3.0:1787098274.082965:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077773952 00000100:00100000:3.0:1787098274.083014:0:11681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077774080 00000100:00100000:3.0:1787098274.083017:0:11681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077774080 00000100:00100000:3.0:1787098274.083032:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787098274.083039:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3311:x1873908077773952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787098274.083046:0:11681:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787098274 with bad export cookie 12815118056897659779 00000100:00100000:3.0:1787098274.083091:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3311:x1873908077773952:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (242us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787098274.083098:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787098274.083115:0:11681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787098274.083119:0:11681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3311:x1873908077774080:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787098274.083131:0:11681:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787098274 with bad export cookie 12815118056897659779 00000100:00100000:3.0:1787098274.083159:0:11681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3311:x1873908077774080:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (232us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787098274.083165:0:11681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787098274.083201:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787098274.083206:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8d7203f99000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787098274.083209:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1787098274.084018:0:13241:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d720fd9a120 - data ffff8d723973d798/ffff8d7241a68800 00000020:01000000:2.0:1787098274.084153:0:13241:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d720640f240 - data ffff8d721dfc75e8/ffff8d7104c4b800 00010000:00010000:1.0:1787098274.085795:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787098274.108317:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.151@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787098274.108323:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787098274.108332:0:3311:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d723ba03480 x1873908077773824/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787098290 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098274.108545:0:3311:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d7241a80380 x1873908077773952/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787098290 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098274.108557:0:3311:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d7241a80a80 x1873908077774080/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787098290 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787098274.108565:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787098274.108568:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787098274.108569:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787098274.108573:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8d7203f99000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787098274.108578:0:3311:0:(import.c:510:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 158 00000100:00080000:3.0:1787098274.108587:0:3311:0:(import.c:624:import_select_connection()) MGC192.168.204.151@tcp: import ffff8d7203f99000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1787098274.108664:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af6522d0-d61c-40bd-bd34-bb282ba82d15:3309:1873908077773824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098274.108677:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7241a81f80 x1873908077774208/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787098274.108709:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:af6522d0-d61c-40bd-bd34-bb282ba82d15:3308:1873908077774208:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1787098274.108755:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873908077774208 offset 0 length 520: 4 00000100:00100000:3.0:1787098274.108805:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077773952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098274.108833:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af6522d0-d61c-40bd-bd34-bb282ba82d15:3311:1873908077774080:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1787098274.116223:0:5830:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1873908077773824 offset 224 length 224: 4 00000100:00100000:1.0:1787098274.116249:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7208e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3309:x1873908077773824:12345-0@lo:103:ldlm_bl.0 Request processed in 37167us (37286us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787098274.116313:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00100000:10000000:1.0:1787098274.127242:0:13241:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787098274.162724:0:13241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01444b7 00000020:00000080:3.0:1787098274.162734:0:13241:0:(genops.c:906:class_export_put()) final put ffff8d7240288800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787098274.162757:0:13241:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7227639800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787098274.162761:0:13241:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7227639800 2 00000020:01000004:3.0:1787098274.162764:0:13241:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d7227639800 from lustre-OST0000 00000020:00000080:3.0:1787098274.162788:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787098274.162799:0:13241:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787098274.162802:0:13241:0:(genops.c:906:class_export_put()) final put ffff8d724028a000/lustre-OST0000_UUID 00000020:00000080:3.0:1787098274.162805:0:13241:0:(genops.c:865:class_export_destroy()) destroying export ffff8d724028a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787098274.162812:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787098274.163060:0:13241:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787098274.163066:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787098274.163071:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787098274.163076:0:13241:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787098274.163084:0:13241:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d7104d94800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787098274.163089:0:13241:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8d72065ecd40) has exports, disconnecting them 00000020:00080000:3.0:1787098274.163094:0:13241:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d7104d94800), last request at 1787098079 00000020:00000080:3.0:1787098274.163098:0:13241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01444e1 00000020:00080000:3.0:1787098274.163108:0:13241:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7104d94800): rc 0 00000020:00000080:3.0:1787098274.163113:0:13241:0:(genops.c:906:class_export_put()) final put ffff8d7104d94800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787098274.163385:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7240288800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787098274.163398:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7104d94800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787098274.164405:0:13241:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787098274.164600:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787098274.164606:0:13241:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787098274.164613:0:13241:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787098274.164661:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7104c20000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787098274.164759:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787098274.164773:0:13241:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787098274.164777:0:13241:0:(genops.c:906:class_export_put()) final put ffff8d7104c26800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787098274.164781:0:13241:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7104c26800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787098274.164786:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787098274.164856:0:13241:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7227639800 1 00000020:00000080:2.0:1787098274.164863:0:13241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144471 00000020:00000080:2.0:1787098274.164868:0:13241:0:(genops.c:906:class_export_put()) final put ffff8d723ad77000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787098274.164874:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787098274.164878:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787098274.164882:0:13241:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787098274.164885:0:13241:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8d723bac19c0) has no exports 00000020:00000080:0.0:1787098274.164929:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723ad77000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787098274.182040:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787098274.182058:0:13241:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787098274.182063:0:13241:0:(genops.c:906:class_export_put()) final put ffff8d722763d800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787098274.182068:0:13241:0:(genops.c:865:class_export_destroy()) destroying export ffff8d722763d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787098274.182075:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787098274.182245:0:13241:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d7227638800 00000020:02000400:0.0:1787098274.182327:0:13241:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787098274.222681:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787098274.447390:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787098274.447401:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787098274.447406:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d7241aaf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787098274.447415:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 367 00000100:00080000:3.0:1787098274.447431:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787098274.447439:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d7241aaf800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1787098274.447504:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7241a80a80 x1873908077774336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787098274.447872:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1873908077774336:0@lo:38:kworker.0 00000400:00000100:2.0:1787098274.447939:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873908077774336 offset 0 length 520: 4 00010000:00010000:1.0:1787098275.290766:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098276.303464:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787098276.765760:0:13392:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787098276.776487:0:13392:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787098276.777132:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.777149:0:13392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.777156:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.777163:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.777586:0:13392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787098276.777593:0:13392:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787098276.777618:0:13392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787098276.777629:0:13392:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d7241a80a80 x1873908077774336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787098289 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098276.777642:0:13392:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787098276.777648:0:13392:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787098276.777654:0:13392:0:(import.c:65:import_set_state_nolock()) ffff8d7241aaf800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787098276.777660:0:13392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787098276.777664:0:13392:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d7241a80a80 x1873908077774336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787098289 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098276.777690:0:13392:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787098276.777694:0:13392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1787098276.778502:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1873908077774336:0@lo:38:kworker.0 00010000:00010000:1.0:1787098276.782009:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.782269:0:13392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.782307:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.782315:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098276.782782:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098276.782789:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098276.782798:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f090a00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098276.782802:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098276.782811:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098276.782817:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098276.782823:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787098276.782826:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787098276.782829:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787098276.782842:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7203f99000 00010000:00010000:3.0:1787098276.782846:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098276.782854:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d720f090a00/0xb1d871f9b014467e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1d871f9b0144685 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098276.782865:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098276.782867:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098276.782891:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d720f090400 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098276.782894:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098276.782901:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098276.782907:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098276.782911:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787098276.782914:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1787098276.782918:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7203f99000 00010000:00010000:3.0:1787098276.782921:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098276.782928:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098276.782930:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098276.782932:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098276.783625:0:13392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787098276.783634:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d720f090400/0xb1d871f9b014468c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1d871f9b0144693 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.783650:0:13392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.783658:0:13392:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.783665:0:13392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.783672:0:13392:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098276.783708:0:13392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787098276.783713:0:13392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1787098276.783716:0:13392:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787098276.783743:0:13392:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787098276.783748:0:13392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787098276.783754:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787098276.783760:0:13392:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787098276.783764:0:13392:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8d720655cd40) has no exports 00000020:00080000:1.0:1787098276.783789:0:13392:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8d720655cd40) has no exports 00010000:00010000:0.0:1787098276.784147:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098276.784154:0:6716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098276.784161:0:6716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413400 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:0.0:1787098276.784164:0:6716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098276.784172:0:6716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787098276.784178:0:6716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098276.784185:0:6716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787098276.784187:0:6716:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787098276.784189:0:6716:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787098276.784198:0:6716:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7203f99000 00010000:00010000:0.0:1787098276.784202:0:6716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098276.784209:0:6716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b01448c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1d871f9b01448ca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098276.784222:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098276.784224:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098276.784225:0:6716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098276.784268:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787098276.792224:0:13392:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d720fd9a000 - data ffff8d721c264a20/ffff8d7239f7b400 00000020:01000000:1.0:1787098276.793983:0:13392:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8d720a310f60 - data ffff8d7239605bd0/ffff8d7241a9b000 00100000:10000000:1.0:1787098276.805782:0:13392:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787098276.847116:0:13392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144582 00000020:00000080:3.0:1787098276.847127:0:13392:0:(genops.c:906:class_export_put()) final put ffff8d72274f4800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787098276.847145:0:13392:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7104c23800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787098276.847149:0:13392:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7104c23800 2 00000020:01000004:3.0:1787098276.847152:0:13392:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d7104c23800 from lustre-OST0001 00000020:00000080:0.0:1787098276.847174:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72274f4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787098276.847179:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787098276.847190:0:13392:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787098276.847193:0:13392:0:(genops.c:906:class_export_put()) final put ffff8d72274f6800/lustre-OST0001_UUID 00000020:00000080:3.0:1787098276.847196:0:13392:0:(genops.c:865:class_export_destroy()) destroying export ffff8d72274f6800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787098276.847203:0:13392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787098276.847381:0:13392:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import af6522d0-d61c-40bd-bd34-bb282ba82d15->MGS 00010000:00010000:3.0:1787098276.847396:0:13392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b014449b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098276.847419:0:13392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b014449b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098276.847426:0:13392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787098276.847429:0:13392:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787098276.847433:0:13392:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787098276.847458:0:13392:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7203f99000 00010000:00010000:3.0:1787098276.847462:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7200031c00/0xb1d871f9b0144494 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1d871f9b014449b expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098276.847480:0:13392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb1d871f9b01446d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098276.847487:0:13392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb1d871f9b01446d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098276.847492:0:13392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787098276.847495:0:13392:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787098276.847497:0:13392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787098276.847519:0:13392:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7203f99000 00010000:00010000:3.0:1787098276.847523:0:13392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d724204ee00/0xb1d871f9b01446d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb1d871f9b01446d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787098276.847541:0:13392:0:(import.c:65:import_set_state_nolock()) ffff8d7203f99000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787098276.847545:0:13392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787098276.847547:0:13392:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787098276.847549:0:13392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787098276.847553:0:13392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787098276.847569:0:13392:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d7241a81f80 x1873908077774208/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787098284 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787098276.847589:0:13392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787098276.847592:0:13392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1787098276.847658:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:af6522d0-d61c-40bd-bd34-bb282ba82d15:3308:1873908077774208:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1787098276.847847:0:13392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787098276.847855:0:13392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144375 00000020:00000080:3.0:1787098276.847861:0:13392:0:(genops.c:906:class_export_put()) final put ffff8d7203f9c000/af6522d0-d61c-40bd-bd34-bb282ba82d15 00000020:01000000:3.0:1787098276.847869:0:13392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.151@tcp (flags='') 00000020:00000080:3.0:1787098276.847874:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787098276.847884:0:13392:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787098276.847888:0:13392:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8d7208e14d40) has no exports 00000020:00000080:0.0:1787098276.847909:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7203f9c000/af6522d0-d61c-40bd-bd34-bb282ba82d15 for MGC192.168.204.151@tcp 10000000:01000000:1.0:1787098276.847958:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787098276.848029:0:13392:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.151@tcp: client import never connected 00000100:00080000:3.0:1787098276.848032:0:13392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787098276.848035:0:13392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787098276.848037:0:13392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787098276.848039:0:13392:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787098276.848076:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787098276.848081:0:13392:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.151@tcp (uuid af6522d0-d61c-40bd-bd34-bb282ba82d15) 00000020:01000000:3.0:1787098276.848085:0:13392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787098276.848089:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787098276.848092:0:13392:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787098276.848097:0:13392:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d7241aae800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787098276.848102:0:13392:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8d723bac3380) has exports, disconnecting them 00000020:00080000:3.0:1787098276.848106:0:13392:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d7241aae800), last request at 1787098096 00000020:00000080:3.0:1787098276.848110:0:13392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b01445ac 00000020:00080000:3.0:1787098276.848119:0:13392:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7241aae800): rc 0 00000020:00000080:3.0:1787098276.848123:0:13392:0:(genops.c:906:class_export_put()) final put ffff8d7241aae800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787098276.848137:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7203f99000 for MGC192.168.204.151@tcp 00000020:00000080:0.0:1787098276.848144:0:38:0:(genops.c:906:class_export_put()) final put ffff8d7203f9b000/af6522d0-d61c-40bd-bd34-bb282ba82d15 00000020:00000080:0.0:1787098276.848147:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7203f9b000/af6522d0-d61c-40bd-bd34-bb282ba82d15 for MGC192.168.204.151@tcp 00000020:01000000:0.0:1787098276.848152:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.151@tcp (af6522d0-d61c-40bd-bd34-bb282ba82d15) 00000020:00000080:0.0:1787098276.848594:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7241aae800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787098276.851499:0:13392:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787098276.851509:0:13392:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787098276.851514:0:13392:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787098276.851520:0:13392:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787098276.851669:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d7241aaf800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787098276.874878:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787098276.875262:0:6716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787098276.878224:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787098276.878811:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d7206997800:5828] 1 exiting: rc = 0 00000100:00100000:2.0:1787098276.878945:0:11680:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d7203e41200:11680] 2 exiting: rc = 0 00000100:00100000:2.0:1787098276.880386:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d7209384000:5827] 0 exiting: rc = 1 00000100:00100000:0.0:1787098276.881260:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.881269:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.882540:0:11681:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8d72410b5e00:11681] 4 exiting: rc = 0 00000100:00100000:2.0:1787098276.882541:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d720a769a00:5829] 0 exiting: rc = 1 00000100:00100000:3.0:1787098276.882611:0:11178:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d723f23bc00:11178] 3 exiting: rc = 0 00000100:00100000:1.0:1787098276.882894:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d720a768400:5831] 2 exiting: rc = 0 00000100:00100000:1.0:1787098276.883641:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d720a768800:5830] 1 exiting: rc = 0 00000100:00100000:0.0:1787098276.883749:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883756:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883762:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883768:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883774:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883779:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883785:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883790:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883796:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883804:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883811:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883816:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883822:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883835:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883841:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883847:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883853:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883859:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883865:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883870:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883876:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883897:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883902:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883907:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883912:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.883917:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884851:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884859:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884864:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884869:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884874:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884879:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884884:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884889:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884894:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884900:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884906:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884911:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.884916:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885135:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885142:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885148:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885152:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885157:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885161:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885169:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885173:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885178:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885184:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885189:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885194:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885200:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885205:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885209:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885214:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885218:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885237:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885242:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885248:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885253:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885258:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885263:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885267:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.885272:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787098276.886866:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787098276.886878:0:13392:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787098276.886884:0:13392:0:(genops.c:906:class_export_put()) final put ffff8d710499d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787098276.886888:0:13392:0:(genops.c:865:class_export_destroy()) destroying export ffff8d710499d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787098276.886900:0:13392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787098276.887009:0:13392:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7104c23800 1 00000020:00000080:0.0:1787098276.887015:0:13392:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xb1d871f9b0144551 00000020:00000080:0.0:1787098276.887021:0:13392:0:(genops.c:906:class_export_put()) final put ffff8d723b46f800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787098276.887125:0:13392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787098276.887131:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787098276.887136:0:13392:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787098276.887139:0:13392:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8d72065e8000) has no exports 00000020:00000080:1.0:1787098276.891104:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723b46f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787098276.918729:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787098276.918748:0:13392:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787098276.918754:0:13392:0:(genops.c:906:class_export_put()) final put ffff8d7104c25800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787098276.918760:0:13392:0:(genops.c:865:class_export_destroy()) destroying export ffff8d7104c25800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787098276.918775:0:13392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787098276.919011:0:13392:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d7104c20800 00000020:01000000:0.0:1787098276.919264:0:13392:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787098276.919270:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787098276.919274:0:13392:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787098276.919309:0:13392:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8d7208e119c0) has no exports 00000020:00000080:0.0:1787098276.919352:0:13392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787098276.919359:0:13392:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787098276.919362:0:13392:0:(genops.c:906:class_export_put()) final put ffff8d723ad70800/OSS_uuid 00000020:00000080:0.0:1787098276.919374:0:13392:0:(genops.c:865:class_export_destroy()) destroying export ffff8d723ad70800/OSS_uuid for OSS 00000020:01000000:0.0:1787098276.919378:0:13392:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787098276.919468:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d7204850800:6701] 0 exiting: rc = 1 00000100:00080000:3.0:1787098276.919479:0:5840:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787098276.919566:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d7207ccae00:6703] 2 exiting: rc = 0 00000100:00100000:3.0:1787098276.919577:0:12017:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8d71043d4800:12017] 4 exiting: rc = 0 00000100:00100000:1.0:1787098276.919618:0:6860:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d723ba99000:6860] 3 exiting: rc = 0 00000100:00100000:3.0:1787098276.921426:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d7204850000:6702] 1 exiting: rc = 0 00000100:00100000:0.0:1787098276.921577:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921586:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921592:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921598:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921604:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921609:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921615:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921621:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921626:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921631:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921635:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921640:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921645:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921650:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921655:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921660:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921682:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921688:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921693:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921697:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921702:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921707:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921712:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921718:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921722:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921728:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921733:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921738:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921743:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921748:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921753:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921759:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921764:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921776:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921782:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921787:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921798:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921807:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921813:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921830:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921835:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921841:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921850:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921856:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921861:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921877:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921884:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921893:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921903:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921910:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.921916:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922413:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922418:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922423:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922429:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922433:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922438:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922446:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922452:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922457:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922462:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922468:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922473:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.922478:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787098276.925724:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d7204851200:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1787098276.925740:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d7207ccb200:6704] 0 exiting: rc = 1 00000100:00100000:0.0:1787098276.925918:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925931:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925937:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925943:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925960:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925965:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925970:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925975:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925980:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925986:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925991:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.925996:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926001:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926006:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926012:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926018:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926024:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926029:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926035:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926040:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926046:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926050:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926054:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926059:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926064:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926069:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926074:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926079:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926085:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926090:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926095:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926100:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926105:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926110:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926114:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926119:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926124:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926133:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926139:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926151:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926156:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926160:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926165:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926170:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926175:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926179:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926185:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926190:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926195:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926201:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926206:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926211:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926218:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926223:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926228:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926233:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926238:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926244:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926250:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926255:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926260:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926266:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926271:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.926277:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.927987:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d7204851400:6706] 0 exiting: rc = 1 00000100:00100000:2.0:1787098276.928249:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d7207ce4e00:6708] 2 exiting: rc = 0 00000100:00100000:1.0:1787098276.928721:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d7204851000:6707] 1 exiting: rc = 0 00000100:00100000:0.0:1787098276.928949:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.928958:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.928964:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.928970:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.928975:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.928981:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.928987:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.928993:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.928999:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929019:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929024:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929147:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929154:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929162:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929167:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929173:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929178:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929184:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929189:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929205:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929212:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929219:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929224:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929230:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929235:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929241:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929247:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929252:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929257:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929262:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929267:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929272:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929523:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929532:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929538:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929544:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929549:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929555:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929560:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929565:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929572:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929577:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929584:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929605:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929617:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929623:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929629:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929634:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929639:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929645:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929651:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929657:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929662:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929668:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929674:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929680:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929685:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929691:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929697:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929703:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929708:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929714:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929719:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.929724:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.943346:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d723f21d600:6709] 0 exiting: rc = 1 00000100:00100000:0.0:1787098276.943830:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d720fdf7e00:6710] 1 exiting: rc = 0 00000100:00100000:2.0:1787098276.944275:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944529:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944549:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944554:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944559:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944564:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944569:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944575:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944580:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944584:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944589:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944594:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944598:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944603:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944609:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944614:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944619:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944625:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944630:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944635:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944640:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944646:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944651:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944656:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944661:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944666:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944672:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944678:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944683:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944688:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944694:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944699:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944705:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944716:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944723:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944729:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944736:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944749:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944755:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944760:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944765:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944770:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944775:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944781:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944787:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944792:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944796:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944801:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944806:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944811:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944884:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944892:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944897:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944903:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944908:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944914:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944987:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944994:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.944999:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.945004:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.945009:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.945014:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.945019:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787098276.945024:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787098276.947773:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d723f21ea00:6712] 1 exiting: rc = 0 00000100:00100000:3.0:1787098276.947873:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d723f21f200:6711] 0 exiting: rc = 1 00000100:00100000:1.0:1787098276.947935:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.947966:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.947980:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.947986:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.947991:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.947997:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948004:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948009:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948015:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948021:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948036:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948043:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948049:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948067:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948073:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948079:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948088:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948095:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948103:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948108:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948114:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948119:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948126:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948138:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948146:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948164:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948170:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948176:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948182:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948188:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948194:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948200:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948208:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948214:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948220:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948226:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948233:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948255:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948261:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948267:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948273:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948310:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948320:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948325:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948331:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948338:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948345:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948350:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948357:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948380:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948387:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948393:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948408:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948414:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948420:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948425:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948431:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948437:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948443:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948449:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948455:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948461:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948466:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787098276.948472:0:13392:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787098276.962541:0:13392:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787098294.565015:0:14005:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787098302.147605:0:14465:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787098302.147611:0:14465:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787098302.147901:0:14465:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d72417b6800 00000020:01000004:0.0:1787098302.148053:0:14465:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787098302.148063:0:14465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787098302.148077:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d724192cd40) 00000020:00000080:0.0:1787098302.148093:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787098302.162601:0:14465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787098302.164891:0:14465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787098302.165465:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 104: rc = 0 00100000:10000000:1.0:1787098302.165649:0:14465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787098302.165716:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 104: rc = 0 00100000:10000000:1.0:1787098302.165827:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 104: rc = 0 00100000:10000000:1.0:1787098302.166003:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 104: rc = 0 00100000:10000000:1.0:1787098302.166170:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 104: rc = 0 00100000:10000000:1.0:1787098302.166267:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 104: rc = 0 00100000:10000000:1.0:1787098302.166552:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 106: rc = 0 00100000:10000000:1.0:1787098302.167741:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 643: rc = 0 00100000:10000000:1.0:1787098302.168570:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 643: rc = 0 00100000:10000000:1.0:1787098302.169134:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 647: rc = 0 00100000:10000000:0.0:1787098302.169719:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 647: rc = 0 00100000:10000000:0.0:1787098302.170128:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 647: rc = 0 00100000:10000000:0.0:1787098302.170439:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:0.0:1787098302.170698:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 647: rc = 0 00100000:10000000:0.0:1787098302.171038:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 647: rc = 0 00100000:10000000:0.0:1787098302.171403:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 647: rc = 0 00100000:10000000:0.0:1787098302.171658:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:0.0:1787098302.171932:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 647: rc = 0 00100000:10000000:0.0:1787098302.172176:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 647: rc = 0 00100000:10000000:0.0:1787098302.172457:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 647: rc = 0 00100000:10000000:0.0:1787098302.172900:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 647: rc = 0 00100000:10000000:0.0:1787098302.173475:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 527: rc = 0 00100000:10000000:0.0:1787098302.173721:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 527: rc = 0 00100000:10000000:0.0:1787098302.174499:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 527: rc = 0 00100000:10000000:0.0:1787098302.174756:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 527: rc = 0 00100000:10000000:0.0:1787098302.175463:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 527: rc = 0 00100000:10000000:0.0:1787098302.175718:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 527: rc = 0 00100000:10000000:0.0:1787098302.178829:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 527: rc = 0 00100000:10000000:0.0:1787098302.179275:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 527: rc = 0 00100000:10000000:0.0:1787098302.179562:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 527: rc = 0 00100000:10000000:0.0:1787098302.180115:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 527: rc = 0 00100000:10000000:0.0:1787098302.180493:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 527: rc = 0 00100000:10000000:0.0:1787098302.180858:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 527: rc = 0 00100000:10000000:0.0:1787098302.181242:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 527: rc = 0 00100000:10000000:0.0:1787098302.181574:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 527: rc = 0 00100000:10000000:0.0:1787098302.182381:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 527: rc = 0 00100000:10000000:0.0:1787098302.182744:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 527: rc = 0 00100000:10000000:0.0:1787098302.183177:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 527: rc = 0 00100000:10000000:0.0:1787098302.183471:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 527: rc = 0 00100000:10000000:0.0:1787098302.183983:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 527: rc = 0 00100000:10000000:0.0:1787098302.184249:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 527: rc = 0 00100000:10000000:0.0:1787098302.184541:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 527: rc = 0 00100000:10000000:0.0:1787098302.184821:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 527: rc = 0 00100000:10000000:0.0:1787098302.185094:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 527: rc = 0 00100000:10000000:0.0:1787098302.185392:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 527: rc = 0 00100000:10000000:0.0:1787098302.185638:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 527: rc = 0 00100000:10000000:0.0:1787098302.185925:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 527: rc = 0 00100000:10000000:0.0:1787098302.188890:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 527: rc = 0 00100000:10000000:0.0:1787098302.189241:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 527: rc = 0 00100000:10000000:0.0:1787098302.189536:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 527: rc = 0 00100000:10000000:0.0:1787098302.189821:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 527: rc = 0 00100000:10000000:0.0:1787098302.191763:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 527: rc = 0 00100000:10000000:0.0:1787098302.192214:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 527: rc = 0 00100000:10000000:0.0:1787098302.192749:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 661: rc = 0 00100000:10000000:0.0:1787098302.193474:0:14465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1787098302.193632:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 515: rc = 0 00100000:10000000:0.0:1787098302.194003:0:14465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787098302.194149:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 515: rc = 0 00100000:10000000:0.0:1787098302.194452:0:14465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1787098302.194521:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 515: rc = 0 00100000:10000000:0.0:1787098302.195246:0:14465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787098302.197399:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:0.0:1787098302.197684:0:14465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787098302.197760:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:0.0:1787098302.197966:0:14465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787098302.198043:0:14465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00000020:00000080:0.0:1787098302.199232:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787098302.199242:0:14465:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787098302.199254:0:14465:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b0145676 00000020:01000004:0.0:1787098302.199263:0:14465:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787098302.199269:0:14465:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787098302.199275:0:14465:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d72417b6800 from MGS 00000020:01000004:0.0:1787098302.199306:0:14465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787098302.199319:0:14465:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d72419299c0) 00000020:00000080:0.0:1787098302.199332:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787098302.199388:0:14465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d72417b6800 from MGS, refs=2 00080000:01000000:0.0:1787098302.199394:0:14465:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787098302.199399:0:14465:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b0145684 00000100:00100000:0.0:1787098302.199519:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787098302.199784:0:14465:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787098302.199793:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787098302.201013:0:14465:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787098302.201024:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787098302.204212:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787098302.204455:0:14465:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787098302.204462:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787098302.206435:0:14465:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787098302.206450:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787098302.207400:0:14465:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787098302.207495:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787098302.214164:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098302.214172:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098302.214175:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098302.214649:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098302.214663:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098302.214665:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098302.215339:0:14465:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787098302.225555:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787098302.236769:0:14465:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787098302.236790:0:14465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787098302.236792:0:14465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787098302.238794:0:14474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787098302.239049:0:14465:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787098302.239151:0:14465:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787098302.239818:0:14465:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787098302.240121:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098302.240316:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787098302.240327:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787098302.249388:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787098302.252315:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787098302.253091:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787098302.253099:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787098302.256515:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787098302.256544:0:14465:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.151@tcp' 00000020:01000004:3.0:1787098302.256546:0:14465:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787098302.256578:0:14465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.151@tcp (typ=mgc) 00000020:00000080:3.0:1787098302.256591:0:14465:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.151@tcp (ffff8d72065eb380) 00000020:00000080:3.0:1787098302.256606:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787098302.256827:0:14465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d72416ba000@MGC192.168.204.151@tcp: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1787098302.257051:0:14465:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.151@tcp-0 is initialized 00000040:01000000:3.0:1787098302.257057:0:14465:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787098302.257482:0:14480:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787098302.257511:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.151@tcp (uuid dc79daaf-8bf3-4a07-a406-566e9526a151) 00000020:00000080:3.0:1787098302.257526:0:14465:0:(genops.c:1406:class_connect()) connect: client dc79daaf-8bf3-4a07-a406-566e9526a151, cookie 0xb1d871f9b0145692 00000100:00080000:3.0:1787098302.257537:0:14465:0:(import.c:510:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787098302.257543:0:14465:0:(import.c:624:import_select_connection()) MGC192.168.204.151@tcp: import ffff8d72416ba000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1787098302.257576:0:14465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7241a80380 x1873908077774464/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787098302.257604:0:14465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dc79daaf-8bf3-4a07-a406-566e9526a151->MGS 00000020:01000004:3.0:1787098302.257622:0:14465:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787098302.257626:0:14465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787098302.257635:0:14465:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d72065e99c0) 00000020:00000080:3.0:1787098302.257645:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787098302.257925:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dc79daaf-8bf3-4a07-a406-566e9526a151:3308:1873908077774464:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787098302.257993:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787098302.258080:0:14479:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1787098302.258179:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077774464 00000100:00100000:1.0:1787098302.258186:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077774464 00000100:00100000:1.0:1787098302.258218:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787098302.258225:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1873908077774464:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787098302.258246:0:14475:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from dc79daaf-8bf3-4a07-a406-566e9526a151@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:1.0:1787098302.258266:0:14475:0:(genops.c:1406:class_connect()) connect: client dc79daaf-8bf3-4a07-a406-566e9526a151, cookie 0xb1d871f9b01456a0 00000100:00080000:1.0:1787098302.258613:0:14475:0:(import.c:65:import_set_state_nolock()) ffff8d7227470000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098302.258681:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+5:3308:x1873908077774464:12345-0@lo:250:mount.lustre.0 Request processed in 454us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098302.258689:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787098302.258875:0:3308:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787098302.258883:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1787098302.258889:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787098302.258902:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787098302.258916:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d72416ba000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787098302.258918:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787098302.258922:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787098302.258926:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dc79daaf-8bf3-4a07-a406-566e9526a151:3308:1873908077774464:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787098302.274721:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787098302.275022:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787098302.275101:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787098302.276987:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787098302.276999:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787098302.278003:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787098302.278012:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787098302.279016:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787098302.279250:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787098302.279255:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787098302.281024:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787098302.281039:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787098302.318984:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787098302.319195:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787098302.319202:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787098302.320681:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787098302.320695:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787098302.321408:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787098302.321592:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787098302.321598:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787098302.322195:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787098302.322202:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787098302.322779:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787098302.322945:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787098302.322950:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787098302.323594:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787098302.323601:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787098302.324166:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787098302.324507:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787098302.324513:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787098302.324928:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787098302.324934:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787098302.341272:0:14465:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787098302.341638:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787098302.341644:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787098302.342809:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787098302.342819:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787098302.343861:0:14465:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787098302.343873:0:14465:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787098302.344752:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787098302.344778:0:14465:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787098302.344785:0:14465:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787098302.344938:0:14465:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787098302.344972:0:14465:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787098302.344977:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787098302.344978:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787098302.344980:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098302.344981:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787098302.344982:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098302.344983:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098302.344984:0:14465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787098302.344985:0:14465:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787098302.344987:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098302.344989:0:14465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787098302.344991:0:14465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787098302.344994:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787098302.344995:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787098302.344996:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098302.344997:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787098302.344998:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098302.344999:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098302.345000:0:14465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787098302.345001:0:14465:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787098302.345007:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098302.345008:0:14465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787098302.345044:0:14465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787098302.345064:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077774592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787098302.345145:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098302.345237:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7208bc6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787098302.345407:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077774592 00000100:00100000:2.0:1787098302.345415:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077774592 00000100:00100000:2.0:1787098302.345493:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098302.345503:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+5:14465:x1873908077774592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787098302.345550:0:14478:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787098302.345553:0:14478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787098302.345556:0:14478:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787098302.345844:0:14499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787098302.346195:0:14478:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787098302.347126:0:14500:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787098302.347131:0:14500:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787098302.347133:0:14500:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787098302.347167:0:14500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787098302.347456:0:14478:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787098302.347466:0:14478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787098302.355145:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+5:14465:x1873908077774592:12345-0@lo:253:mount.lustre.0 Request processed in 9635us (9992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.355165:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787098302.355304:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077774592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787098302.355322:0:14465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787098302.355326:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787098302.355328:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787098302.355330:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098302.355332:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787098302.355333:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098302.355334:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098302.355335:0:14465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787098302.355337:0:14465:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787098302.355338:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098302.355339:0:14465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787098302.355361:0:14465:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d72417b6800 from lustre-MDT0000 10000000:01000000:1.0:1787098302.355389:0:14465:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787098302.355392:0:14465:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787098302.355397:0:14465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d72065eb380 10000000:01000000:1.0:1787098302.355401:0:14465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787098302.355409:0:14465:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8d72065eb380 from 1 10000000:01000000:1.0:1787098302.355412:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787098302.355449:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.355460:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.355470:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098302.355507:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077774720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787098302.355545:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098302.355585:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7208bc63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098302.355655:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077774720 00000100:00100000:0.0:1787098302.355662:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077774720 00000100:00100000:0.0:1787098302.355839:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098302.355850:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240323050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+5:14465:x1873908077774720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787098302.355866:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098302.355884:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208694400/0xb1d871f9b01456ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01456a7 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.355936:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208694400/0xb1d871f9b01456ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01456a7 expref: 6 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.355948:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208694400/0xb1d871f9b01456ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01456a7 expref: 6 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.355959:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694400, rc 0) 00000100:00100000:0.0:1787098302.356009:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240323050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+6:14465:x1873908077774720:12345-0@lo:101:mount.lustre.0 Request processed in 161us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098302.356016:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787098302.356095:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077774720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787098302.356110:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.356119:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098302.356170:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077774848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098302.356205:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.356556:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209e993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098302.356623:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077774848 00000100:00100000:1.0:1787098302.356628:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077774848 00000100:00100000:1.0:1787098302.356654:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787098302.356662:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240321050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+6:14465:x1873908077774848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787098302.356997:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240321050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+6:14465:x1873908077774848:12345-0@lo:501:mount.lustre.0 Request processed in 334us (790us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787098302.357007:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787098302.357093:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077774848:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787098302.357121:0:14465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787098302.357144:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.357154:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098302.357175:0:14465:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d72417b6800 10000000:01000000:2.0:1787098302.357180:0:14465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787098302.357185:0:14465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d72417b6800 10000000:01000000:2.0:1787098302.357189:0:14465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787098302.357191:0:14465:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8d72417b6800 from 1 10000000:01000000:2.0:1787098302.357194:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787098302.357216:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227622c00/0xb1d871f9b01456b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.357224:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227622c00/0xb1d871f9b01456b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.357233:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227622c00/0xb1d871f9b01456b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098302.357248:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077774976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787098302.357276:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.357308:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209e993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098302.357371:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077774976 00000100:00100000:1.0:1787098302.357375:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077774976 00000100:00100000:1.0:1787098302.357394:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787098302.357401:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+6:14465:x1873908077774976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787098302.357409:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098302.357421:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227412a00/0xb1d871f9b01456bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01456b5 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.357437:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227412a00/0xb1d871f9b01456bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01456b5 expref: 7 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.357445:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227412a00/0xb1d871f9b01456bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01456b5 expref: 7 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.357453:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412a00, rc 0) 00000100:00100000:1.0:1787098302.357488:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+7:14465:x1873908077774976:12345-0@lo:101:mount.lustre.0 Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098302.357507:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098302.357585:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077774976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787098302.357596:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227622c00/0xb1d871f9b01456b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456bc expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.357605:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227622c00/0xb1d871f9b01456b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01456bc expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098302.357616:0:14465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787098302.357622:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227622c00/0xb1d871f9b01456b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456bc expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.357635:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227622c00/0xb1d871f9b01456b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456bc expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098302.357641:0:14465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787098302.357644:0:14465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787098302.357649:0:14465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d72417b6800 10000000:01000000:2.0:1787098302.357651:0:14465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787098302.357653:0:14465:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787098302.357655:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787098302.357670:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227622a00/0xb1d871f9b01456c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.357677:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227622a00/0xb1d871f9b01456c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.357685:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227622a00/0xb1d871f9b01456c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098302.357702:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077775104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787098302.357728:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.357760:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209e993c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098302.357771:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077775104 00000100:00100000:3.0:1787098302.357775:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077775104 00000100:00100000:3.0:1787098302.357815:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787098302.357823:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240322450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+7:14465:x1873908077775104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787098302.357831:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098302.357841:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01456ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01456c3 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.357861:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01456ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01456c3 expref: 8 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.357869:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200031c00/0xb1d871f9b01456ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01456c3 expref: 8 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.357888:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200031c00, rc 0) 00000100:00100000:3.0:1787098302.357931:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240322450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+8:14465:x1873908077775104:12345-0@lo:101:mount.lustre.0 Request processed in 109us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.357936:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787098302.358001:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077775104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787098302.358011:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227622a00/0xb1d871f9b01456c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ca expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.358019:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227622a00/0xb1d871f9b01456c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01456ca expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098302.358074:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077775232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098302.358099:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.358152:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209e993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098302.358191:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077775232 00000100:00100000:0.0:1787098302.358196:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077775232 00000100:00100000:0.0:1787098302.358262:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787098302.358270:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+8:14465:x1873908077775232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787098302.358639:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+9:14465:x1873908077775232:12345-0@lo:501:mount.lustre.0 Request processed in 369us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098302.358647:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787098302.358710:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077775232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098302.358750:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077775360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787098302.358787:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.358889:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209e993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098302.359033:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077775360 00000100:00100000:1.0:1787098302.359038:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077775360 00000100:00100000:1.0:1787098302.359062:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787098302.359069:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240322c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+9:14465:x1873908077775360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787098302.359390:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240322c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+9:14465:x1873908077775360:12345-0@lo:503:mount.lustre.0 Request processed in 321us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098302.359399:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787098302.359492:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077775360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787098302.360140:0:14501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14501:1873908077775488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098302.360185:0:14501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.360257:0:14501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209e99600 going to sleep for 11 seconds 00000100:00100000:1.0:1787098302.360544:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077775488 00000100:00100000:1.0:1787098302.360550:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077775488 00000100:00100000:1.0:1787098302.360588:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787098302.360597:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+9:14501:x1873908077775488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787098302.360889:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+9:14501:x1873908077775488:12345-0@lo:502:llog_process_th.0 Request processed in 293us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098302.360897:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787098302.361099:0:14501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14501:1873908077775488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787098302.361126:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098302.361140:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098302.361142:0:14501:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787098302.361148:0:14501:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787098302.361151:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787098302.361166:0:14501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d720655b380) 00000020:00000080:2.0:1787098302.361182:0:14501:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787098302.361187:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787098302.361261:0:14501:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787098302.361269:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b01456d8 00000020:00000080:2.0:1787098302.361578:0:14501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787098302.361583:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098302.361587:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098302.361593:0:14501:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787098302.361596:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098302.361600:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098302.361602:0:14501:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787098302.361605:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787098302.361612:0:14501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d7206558000) 00000020:00000080:2.0:1787098302.361623:0:14501:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787098302.361627:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787098302.361629:0:14501:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787098302.361632:0:14501:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787098302.361639:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787098302.361678:0:14501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d72417b6800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787098302.361691:0:14501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d72065599c0) 00000020:00000080:2.0:1787098302.361698:0:14501:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787098302.361746:0:14501:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787098302.361752:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b01456ed 00000020:00000080:2.0:1787098302.361872:0:14501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787098302.361879:0:14501:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787098302.361885:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb1d871f9b01456f4 00080000:01000000:2.0:1787098302.361889:0:14501:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787098302.361892:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b01456fb 00010000:00010000:3.0:1787098302.448384:0:14501:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787098302.449271:0:14501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787098302.449619:0:14501:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787098302.450553:0:14501:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d72065e8000) 00000020:00000080:3.0:1787098302.450574:0:14501:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787098302.450651:0:14501:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787098302.450659:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b0145709 00000020:00000080:3.0:1787098302.451404:0:14501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787098302.466644:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb1d871f9b0145710 00000020:00000080:3.0:1787098302.467394:0:14501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787098302.467406:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787098302.467412:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.467414:0:14501:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787098302.467431:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787098302.467434:0:14501:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787098302.467436:0:14501:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787098302.467438:0:14501:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787098302.467439:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787098302.467442:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.467444:0:14501:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787098302.467447:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787098302.467452:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.467453:0:14501:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787098302.467457:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787098302.467493:0:14501:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787098302.467506:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787098302.467515:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.467516:0:14501:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787098302.467521:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787098302.467524:0:14501:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787098302.467527:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.467529:0:14501:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787098302.467532:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787098302.467537:0:14501:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:3.0:1787098302.467563:0:14501:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787098302.467566:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787098302.467579:0:14501:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d72065ecd40) 00000020:00000080:3.0:1787098302.467593:0:14501:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787098302.467598:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787098302.467652:0:14501:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787098302.467657:0:14501:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787098302.467662:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b014571e 00010000:00080000:3.0:1787098302.467690:0:14501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d72417a4000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1787098302.468519:0:14501:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787098302.469537:0:14501:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787098302.469593:0:14501:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787098302.471572:0:14501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787098302.471634:0:14501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787098302.471693:0:14501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787098302.472571:0:14505:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787098302.472576:0:14505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787098302.473909:0:14501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787098302.474211:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787098302.474252:0:14501:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787098302.474272:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b0145725 00000100:00080000:3.0:1787098302.474389:0:14501:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787098302.474396:0:14501:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d72417a4000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1787098302.474538:0:14501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7241a82d80 x1873908077775616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787098302.474629:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077775616:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787098302.474684:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873908077775616 offset 0 length 520: 4 00000100:00080000:3.0:1787098302.474784:0:14501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787098302.474956:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787098302.474961:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.474963:0:14501:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787098302.474965:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787098302.474968:0:14501:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787098302.474970:0:14501:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787098302.474971:0:14501:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787098302.474972:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787098302.475043:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.475045:0:14501:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787098302.475050:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787098302.475170:0:14501:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787098302.475175:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.475177:0:14501:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787098302.475181:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787098302.475185:0:14501:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:3.0:1787098302.475206:0:14501:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787098302.475208:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787098302.475230:0:14501:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d7205790000) 00000020:00000080:3.0:1787098302.475243:0:14501:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787098302.475249:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787098302.475501:0:14501:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787098302.475507:0:14501:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787098302.475513:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb1d871f9b0145733 00010000:00080000:3.0:1787098302.475544:0:14501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d723b573800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1787098302.475893:0:14501:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787098302.476578:0:14501:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787098302.476599:0:14501:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787098302.477629:0:14501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787098302.477690:0:14501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787098302.478223:0:14501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787098302.478854:0:14507:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787098302.478859:0:14507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787098302.481250:0:14501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787098302.481264:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787098302.481459:0:14501:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787098302.481480:0:14501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b014573a 00000100:00080000:2.0:1787098302.481491:0:14501:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787098302.481497:0:14501:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d723b573800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1787098302.481536:0:14501:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723ba41f80 x1873908077775744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787098302.481608:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077775744:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787098302.481662:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873908077775744 offset 0 length 520: 4 00000100:00080000:2.0:1787098302.481729:0:14501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787098302.481806:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098302.481811:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098302.481824:0:14501:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787098302.481828:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098302.481833:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098302.481834:0:14501:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787098302.481837:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787098302.481839:0:14501:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787098302.481840:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098302.481843:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098302.481844:0:14501:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787098302.481846:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098302.481848:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098302.481849:0:14501:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787098302.481852:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787098302.481886:0:14501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14501:1873908077775872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098302.481946:0:14501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.481963:0:14501:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209e99600 going to sleep for 11 seconds 00000100:00100000:3.0:1787098302.482371:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077775872 00000100:00100000:3.0:1787098302.482379:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077775872 00000100:00100000:3.0:1787098302.482425:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787098302.482434:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240322850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+9:14501:x1873908077775872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098302.482680:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240322850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+9:14501:x1873908077775872:12345-0@lo:502:llog_process_th.0 Request processed in 246us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.482687:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787098302.483275:0:14501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14501:1873908077775872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787098302.483338:0:14501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098302.483345:0:14501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098302.483346:0:14501:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787098302.483350:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787098302.483542:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787098302.483561:0:14465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787098302.483585:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227622a00/0xb1d871f9b01456c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ca expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.483597:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227622a00/0xb1d871f9b01456c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ca expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098302.483604:0:14465:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d72417b6800 from 1 10000000:01000000:1.0:1787098302.483607:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787098302.483638:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.483657:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.483667:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098302.483683:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787098302.483732:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098302.483762:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72065103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098302.483933:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077776000 00000100:00100000:3.0:1787098302.483939:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077776000 00000100:00100000:3.0:1787098302.483986:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787098302.483995:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+9:14465:x1873908077776000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787098302.484005:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098302.484019:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0145741 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.484414:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0145741 expref: 10 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.484427:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145741 expref: 10 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.484436:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200031a00, rc 0) 00000100:00100000:3.0:1787098302.484480:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+10:14465:x1873908077776000:12345-0@lo:101:mount.lustre.0 Request processed in 486us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.484488:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787098302.484574:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787098302.484587:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.484595:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098302.485566:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776128:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787098302.485623:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098302.485699:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72065103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098302.486205:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077776128 00000100:00100000:3.0:1787098302.486212:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077776128 00000100:00100000:3.0:1787098302.486316:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787098302.486334:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240320050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+10:14465:x1873908077776128:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787098302.486355:0:14477:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787098302.486361:0:14477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787098302.486442:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240320050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+10:14465:x1873908077776128:12345-0@lo:256:mount.lustre.0 Request processed in 110us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.486450:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787098302.486572:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776128:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787098302.487221:0:14465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787098302.487249:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.487261:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098302.487354:0:14465:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d72417b6800 from 1 10000000:01000000:1.0:1787098302.487357:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787098302.487390:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.487399:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.487408:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098302.487427:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787098302.487467:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098302.488513:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72065103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098302.488583:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077776256 00000100:00100000:2.0:1787098302.488591:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077776256 00000100:00100000:2.0:1787098302.488636:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787098302.488644:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+10:14465:x1873908077776256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787098302.488659:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098302.488679:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014574f expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.488703:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014574f expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.488742:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014574f expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.488751:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623200, rc 0) 00000100:00100000:2.0:1787098302.488814:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14465:x1873908077776256:12345-0@lo:101:mount.lustre.0 Request processed in 170us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098302.488821:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787098302.489040:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787098302.489224:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.489235:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098302.489342:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787098302.489375:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098302.489390:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72065103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098302.489586:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077776384 00000100:00100000:2.0:1787098302.489591:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077776384 00000100:00100000:2.0:1787098302.489612:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787098302.489618:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14465:x1873908077776384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098302.490589:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14465:x1873908077776384:12345-0@lo:501:mount.lustre.0 Request processed in 967us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098302.490599:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787098302.491230:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787098302.491427:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787098302.491489:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098302.491557:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72065103c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098302.491677:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077776512 00000100:00100000:0.0:1787098302.491683:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077776512 00000100:00100000:0.0:1787098302.491837:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787098302.491847:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14465:x1873908077776512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787098302.492337:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787098302.492574:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14465:x1873908077776512:12345-0@lo:503:mount.lustre.0 Request processed in 210us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098302.492582:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787098302.492775:0:14509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14509:1873908077776640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098302.492868:0:14509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.492905:0:14509:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723f2d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098302.492923:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077776640 00000100:00100000:0.0:1787098302.492928:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077776640 00000100:00100000:0.0:1787098302.492963:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787098302.493037:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14509:x1873908077776640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098302.493267:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14509:x1873908077776640:12345-0@lo:502:llog_process_th.0 Request processed in 296us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098302.493274:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787098302.493313:0:14509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14509:1873908077776640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787098302.493338:0:14509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787098302.493347:0:14509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.493350:0:14509:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787098302.493357:0:14509:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d72417b6800 00000020:00000080:3.0:1787098302.493360:0:14509:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787098302.493369:0:14509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787098302.493371:0:14509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.493373:0:14509:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787098302.493375:0:14509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787098302.493378:0:14509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.493379:0:14509:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787098302.493382:0:14509:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d72417b6800 00000020:00000080:3.0:1787098302.493384:0:14509:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787098302.493443:0:14509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787098302.493447:0:14509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.493448:0:14509:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787098302.493451:0:14509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787098302.493454:0:14509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787098302.493455:0:14509:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787098302.493458:0:14509:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d72417b6800 00000020:00000080:3.0:1787098302.493460:0:14509:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787098302.493494:0:14509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14509:1873908077776768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098302.493527:0:14509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098302.493561:0:14509:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7f89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098302.493742:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077776768 00000100:00100000:0.0:1787098302.493748:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077776768 00000100:00100000:0.0:1787098302.493776:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787098302.493782:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14509:x1873908077776768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098302.493936:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14509:x1873908077776768:12345-0@lo:502:llog_process_th.0 Request processed in 153us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098302.493943:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787098302.494214:0:14509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a83100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14509:1873908077776768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787098302.494236:0:14509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098302.494242:0:14509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098302.494243:0:14509:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787098302.494247:0:14509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787098302.494622:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787098302.494644:0:14465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787098302.494667:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.494679:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098302.494736:0:14465:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787098302.494739:0:14465:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d72417b6800 10000000:01000000:0.0:1787098302.494742:0:14465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d72417b6800 10000000:01000000:0.0:1787098302.494746:0:14465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787098302.494751:0:14465:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d72417b6800 from 1 10000000:01000000:0.0:1787098302.494754:0:14465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787098302.494779:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695e00/0xb1d871f9b014575d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.494787:0:14465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208695e00/0xb1d871f9b014575d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.494816:0:14465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208695e00/0xb1d871f9b014575d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098302.494845:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787098302.494881:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098302.494921:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722810e480 going to sleep for 11 seconds 00000100:00100000:3.0:1787098302.495130:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077776896 00000100:00100000:3.0:1787098302.495135:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077776896 00000100:00100000:3.0:1787098302.495171:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787098302.495180:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14465:x1873908077776896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787098302.495191:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098302.495205:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200031200/0xb1d871f9b0145764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014575d expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.495228:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200031200/0xb1d871f9b0145764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014575d expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.495238:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200031200/0xb1d871f9b0145764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014575d expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.495248:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200031200, rc 0) 00000100:00100000:3.0:1787098302.495426:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14465:x1873908077776896:12345-0@lo:101:mount.lustre.0 Request processed in 246us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.495433:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787098302.495540:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077776896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787098302.495554:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208695e00/0xb1d871f9b014575d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145764 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.495572:0:14465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208695e00/0xb1d871f9b014575d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145764 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098302.495623:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077777024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098302.495653:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.495719:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723f2d7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098302.495752:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077777024 00000100:00100000:3.0:1787098302.495756:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077777024 00000100:00100000:3.0:1787098302.495841:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787098302.495850:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14465:x1873908077777024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787098302.496410:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14465:x1873908077777024:12345-0@lo:501:mount.lustre.0 Request processed in 559us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.496419:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787098302.496525:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077777024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098302.496555:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077777152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787098302.496591:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.496653:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723f2d7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787098302.496686:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077777152 00000100:00100000:0.0:1787098302.496691:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077777152 00000100:00100000:0.0:1787098302.496752:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787098302.496759:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14465:x1873908077777152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787098302.496930:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14465:x1873908077777152:12345-0@lo:503:mount.lustre.0 Request processed in 171us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098302.496937:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787098302.497226:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077777152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787098302.497526:0:14511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14511:1873908077777280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787098302.497562:0:14511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.499479:0:14511:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d723f2d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098302.499556:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077777280 00000100:00100000:0.0:1787098302.499564:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077777280 00000100:00100000:0.0:1787098302.499654:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787098302.499664:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14511:x1873908077777280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098302.500066:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14511:x1873908077777280:12345-0@lo:502:llog_process_th.0 Request processed in 403us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098302.500076:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787098302.500212:0:14511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14511:1873908077777280:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787098302.500390:0:14511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787098302.500413:0:14511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d720655cd40) 00000020:00000080:2.0:1787098302.500441:0:14511:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787098302.500646:0:14511:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d72417b6800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787098302.500651:0:14511:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d72417b6800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787098302.500654:0:14511:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d72417b6800 4 00010000:00080000:2.0:1787098302.500681:0:14511:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7241aab000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1787098302.503128:0:14511:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787098302.503246:0:14511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787098302.503412:0:14511:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787098302.503424:0:14511:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb1d871f9b0145772 00000100:00080000:2.0:1787098302.503434:0:14511:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787098302.503439:0:14511:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d7241aab000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1787098302.503473:0:14511:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723ba40700 x1873908077777408/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787098302.503503:0:14511:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787098302.503520:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077777408:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787098302.503594:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098302.503642:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077777408 00000100:00100000:2.0:1787098302.503650:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077777408 00000100:00100000:2.0:1787098302.503679:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787098302.503685:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1873908077777408:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787098302.503741:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1873908077777408:12345-0@lo:38:llog_process_th.0 Request processed in 54us (146us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787098302.503748:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787098302.504089:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787098302.504097:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7241aab000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787098302.504102:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787098302.504105:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077777408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787098302.508058:0:14511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14511:1873908077777536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787098302.508144:0:14511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098302.508193:0:14511:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722810eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098302.508210:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077777536 00000100:00100000:3.0:1787098302.508218:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077777536 00000100:00100000:3.0:1787098302.508268:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787098302.508298:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204f00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14511:x1873908077777536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787098302.508537:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204f00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14511:x1873908077777536:12345-0@lo:502:llog_process_th.0 Request processed in 255us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.508545:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787098302.509466:0:14511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dc79daaf-8bf3-4a07-a406-566e9526a151:14511:1873908077777536:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787098302.509505:0:14511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787098302.509809:0:14465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787098302.509832:0:14465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787098302.509857:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695e00/0xb1d871f9b014575d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145764 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.509867:0:14465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208695e00/0xb1d871f9b014575d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145764 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787098302.509913:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787098302.509915:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787098302.509917:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787098302.509918:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787098302.509919:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787098302.509921:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787098302.509922:0:14465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787098302.509923:0:14465:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787098302.509925:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787098302.509927:0:14465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787098302.509930:0:14465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787098302.509933:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787098302.509934:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787098302.509935:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787098302.509936:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787098302.509937:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787098302.509938:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787098302.509939:0:14465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787098302.509940:0:14465:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787098302.509942:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787098302.509943:0:14465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787098302.509969:0:14465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787098302.509996:0:14465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077777664:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787098302.510380:0:14465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098302.510418:0:14465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a78ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098302.510439:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077777664 00000100:00100000:3.0:1787098302.510444:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077777664 00000100:00100000:3.0:1787098302.510478:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787098302.510486:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14465:x1873908077777664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787098302.510510:0:14478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787098302.510522:0:14478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787098302.577753:0:14478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787098302.577821:0:14478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787098302.577892:0:14499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787098302.578017:0:14499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787098302.578048:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.578188:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145741 expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.578262:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.578344:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0145741 expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098302.578363:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0145741 expref: 12 pid: 14475 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098302.578385:0:14499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba02300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14499:1873908077777792:0@lo:104: 00000100:00100000:0.0:1787098302.578552:0:14499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098302.578633:0:14499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722810e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787098302.578891:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077777792 00000100:00100000:3.0:1787098302.578910:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077777792 00000100:00100000:3.0:1787098302.579011:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098302.579024:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+3:14499:x1873908077777792:12345-0@lo:104: 00010000:00010000:3.0:1787098302.579040:0:14466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.579120:0:14466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098302.579126:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+3:14499:x1873908077777792:12345-0@lo:104: Request processed in 106us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.579134:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787098302.579206:0:14499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba02300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14499:1873908077777792:0@lo:104: 00010000:00010000:1.0:1787098302.579238:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.580375:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098302.580389:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.580402:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413400 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098302.580407:0:14472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.580418:0:14472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098302.580427:0:14472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098302.580434:0:14472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787098302.580503:0:14472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.580511:0:14472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098302.580545:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.580553:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b0145741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145748 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098302.580574:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098302.580577:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077777920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098302.580578:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098302.580582:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098302.580761:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098302.581017:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077777920 00000100:00100000:3.0:1787098302.581026:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077777920 00010000:00010000:3.0:1787098302.581062:0:14468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0145741 expref: 13 pid: 14475 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098302.581145:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098302.581157:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+13:3309:x1873908077777920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787098302.581172:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098302.581187:0:14468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0145741 expref: 13 pid: 14475 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581199:0:14468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0145741 expref: 13 pid: 14475 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581216:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200031a00/0xb1d871f9b0145748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0145741 expref: 13 pid: 14475 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581232:0:14468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581241:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787098302.581258:0:14468:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003360205s 00010000:00010000:3.0:1787098302.581263:0:14468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581270:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581318:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581327:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581333:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098302.581339:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581358:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581380:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098302.581391:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098302.581432:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+12:3309:x1873908077777920:12345-0@lo:103:ldlm_bl.0 Request processed in 277us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098302.581442:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787098302.581464:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077777920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787098302.581494:0:14499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.581504:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098302.581512:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208695800/0xb1d871f9b0145779 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098302.598479:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14465:x1873908077777664:12345-0@lo:253:mount.lustre.0 Request processed in 87980us (88409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098302.598500:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787098302.598708:0:14465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:14465:1873908077777664:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787098302.598730:0:14465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787098302.598734:0:14465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787098302.598735:0:14465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787098302.598737:0:14465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787098302.598738:0:14465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787098302.598739:0:14465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787098302.598740:0:14465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787098302.598742:0:14465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787098302.598744:0:14465:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787098302.598746:0:14465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787098302.598747:0:14465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787098302.598765:0:14465:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787098302.609859:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787098302.610737:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787098302.611152:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787098302.612706:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787098302.613139:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098302.613999:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787098302.615008:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098302.615173:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787098302.615975:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098302.616377:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787098302.616679:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098302.616846:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787098302.644972:0:14465:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787098302.645227:0:14465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787098302.646991:0:14523:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787098302.646997:0:14523:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787098302.649048:0:14524:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787098302.649137:0:14524:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787098302.652086:0:14465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787098302.652216:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787098302.653544:0:14465:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787098302.653561:0:14465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787098302.653620:0:14524:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787098302.653686:0:14524:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787098302.653691:0:14524:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1787098302.653750:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787098302.655003:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787098302.655776:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787098302.655825:0:14465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787098302.658758:0:14465:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787098302.664562:0:14465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787098302.695224:0:14465:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787098302.695256:0:14465:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa82380e2b988 00100000:10000000:3.0:1787098302.695276:0:14465:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787098302.696044:0:14465:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787098302.696059:0:14465:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787098302.696090:0:14465:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787098302.696119:0:14465:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787098303.247544:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787098303.569619:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787098303.642342:0:14480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787098303.642351:0:14480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d72417b6800 from 6 10000000:01000000:0.0:1787098303.642357:0:14480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787098303.642408:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098303.642420:0:14480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098303.642432:0:14480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098303.642465:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077778048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787098303.642564:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098303.642618:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203e13480 going to sleep for 11 seconds 00000100:00100000:0.0:1787098303.642649:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077778048 00000100:00100000:0.0:1787098303.642658:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077778048 00000100:00100000:0.0:1787098303.642714:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787098303.642722:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14480:x1873908077778048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098303.642738:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098303.642752:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0145780 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098303.642786:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0145780 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098303.642812:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145780 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098303.642823:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208694600, rc 0) 00000100:00100000:0.0:1787098303.642866:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14480:x1873908077778048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098303.642874:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787098303.642918:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077778048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098303.642932:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098303.642941:0:14480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098303.642988:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077778176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787098303.643018:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098303.643035:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203e13480 going to sleep for 11 seconds 00000100:00100000:0.0:1787098303.643048:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077778176 00000100:00100000:0.0:1787098303.643052:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077778176 00000100:00100000:0.0:1787098303.643072:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787098303.643078:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14480:x1873908077778176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787098303.643091:0:14478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787098303.643107:0:14478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787098303.643110:0:14478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787098303.643184:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14480:x1873908077778176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098303.643200:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787098303.643230:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077778176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787098303.643269:0:14480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787098303.643276:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098303.643306:0:14480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098304.271539:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787098304.592648:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787098305.298031:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098306.319554:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787098306.816363:0:14767:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787098307.344228:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787098307.727493:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787098307.727500:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787098307.727503:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787098307.727507:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787098307.727509:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787098307.727513:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787098307.727516:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d7241aab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787098307.727530:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d7241aab000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1787098307.727561:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7106020700 x1873908077778432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787098307.727627:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077778432:0@lo:38:kworker.0 00000100:00100000:1.0:1787098307.727702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098307.727777:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077778432 00000100:00100000:1.0:1787098307.727784:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077778432 00000100:00100000:1.0:1787098307.727814:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787098307.727821:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1873908077778432:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787098307.727847:0:14485:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:1.0:1787098307.727882:0:14485:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb1d871f9b014578e 00000004:00100000:1.0:1787098307.727898:0:14485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787098307.728022:0:14485:0:(import.c:65:import_set_state_nolock()) ffff8d7208c35000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098307.728076:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873908077778432:12345-0@lo:38:kworker.0 Request processed in 253us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098307.728083:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787098307.728121:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d7106020700 x1873908077778432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787098317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787098307.728136:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787098307.728142:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787098307.728147:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787098307.728149:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7241aab000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787098307.728154:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873908077778432:0@lo:38:kworker.0 00000100:00100000:0.0:1787098307.728220:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098307.728231:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077778304:0@lo:400:kworker.0 00000100:00100000:0.0:1787098307.728268:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098307.730891:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077778304 00000100:00100000:1.0:1787098307.730905:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077778304 00000100:00100000:1.0:1787098307.730966:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787098307.730976:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:3309:x1873908077778304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098307.731078:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:3309:x1873908077778304:12345-0@lo:400:kworker.0 Request processed in 104us (2808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098307.731086:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787098307.731240:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077778304:0@lo:400:kworker.0 00010000:00010000:2.0:1787098308.367595:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098309.398585:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787098309.781795:0:14917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7dc86910 20000000:00000080:0.0:1787098309.781813:0:14917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d72086c7800 uarg=0000000000000000 20000000:01000000:0.0:1787098309.781847:0:14917:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787098309.781854:0:14917:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787098309.781858:0:14917:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787098309.785077:0:14918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787098309.785803:0:14917:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787098309.800372:0:14917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787098309.800559:0:14917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098309.800580:0:14917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014574f expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098309.800589:0:14917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098309.800636:0:14917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b014574f expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098309.800660:0:14917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b014574f expref: 11 pid: 14478 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098309.800677:0:14917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14917:1873908077778560:0@lo:104: 00000100:00100000:1.0:1787098309.800746:0:14917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098309.800802:0:14917:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098309.800880:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077778560 00000100:00100000:3.0:1787098309.800887:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077778560 00000100:00100000:3.0:1787098309.800946:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787098309.800969:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106023800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+3:14917:x1873908077778560:12345-0@lo:104: 00010000:00010000:3.0:1787098309.800981:0:14466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098309.801039:0:14466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098309.801046:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106023800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+3:14917:x1873908077778560:12345-0@lo:104: Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098309.801063:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787098309.801317:0:14917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14917:1873908077778560:0@lo:104: 00010000:00010000:1.0:1787098309.801337:0:14917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801498:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098309.801505:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801514:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413c00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098309.801517:0:14472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801526:0:14472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098309.801533:0:14472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098309.801553:0:14472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787098309.801584:0:14472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801591:0:14472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098309.801626:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801633:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b014574f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145756 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801649:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098309.801662:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098309.801664:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098309.801685:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787098309.801700:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077778688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787098309.801740:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098309.801789:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077778688 00000100:00100000:2.0:1787098309.801793:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077778688 00010000:00010000:2.0:1787098309.801819:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014574f expref: 12 pid: 14478 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098309.801842:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098309.801849:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+12:3312:x1873908077778688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098309.801860:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098309.801865:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014574f expref: 12 pid: 14478 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801876:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b014574f expref: 12 pid: 14478 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801895:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227623200/0xb1d871f9b0145756 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b014574f expref: 12 pid: 14478 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801909:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801917:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801930:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801937:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.801944:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.802153:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.802158:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098309.802162:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.802302:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098309.806935:0:14917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.807220:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098309.807268:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787098309.807382:0:14917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098309.807399:0:14917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145795 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098309.809249:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+11:3312:x1873908077778688:12345-0@lo:103:ldlm_bl.0 Request processed in 7392us (7500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098309.809266:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787098309.809404:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077778688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098310.415544:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098311.443207:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787098311.695528:0:14480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787098311.695535:0:14480:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d72417b6800 from 10 10000000:01000000:1.0:1787098311.695541:0:14480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787098311.695589:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098311.695601:0:14480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098311.695624:0:14480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098311.695651:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077778816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787098311.696582:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098311.697174:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710603b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098311.701672:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077778816 00000100:00100000:3.0:1787098311.701688:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077778816 00000100:00100000:2.0:1787098311.708003:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787098311.708019:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+11:14480:x1873908077778816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098311.708038:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098311.708061:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014579c expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098311.708099:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014579c expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098311.708111:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014579c expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098311.708120:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623600, rc 0) 00000100:00100000:2.0:1787098311.708215:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14480:x1873908077778816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (11635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098311.708222:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787098311.708329:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077778816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098311.708358:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098311.708368:0:14480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098311.708440:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077778944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098311.708475:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098311.712251:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209ee5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787098311.712489:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077778944 00000100:00100000:1.0:1787098311.712497:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077778944 00000100:00100000:1.0:1787098311.712542:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787098311.712551:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14480:x1873908077778944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098311.713001:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14480:x1873908077778944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (4522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098311.713009:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787098311.713477:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077778944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098311.713530:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077779072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098311.713579:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098311.713607:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209ee5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098311.713631:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077779072 00000100:00100000:3.0:1787098311.713636:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077779072 00000100:00100000:3.0:1787098311.713662:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787098311.713668:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14480:x1873908077779072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098311.714610:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:14480:x1873908077779072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 938us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098311.714633:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787098311.714702:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077779072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787098311.716231:0:14999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787098311.716535:0:14480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787098311.716555:0:14480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787098311.716566:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098311.716578:0:14480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098312.468670:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098312.852824:0:3308:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787098302/real 1787098302] req@ffff8d723ba41f80 x1873908077775744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787098312 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098312.852860:0:3308:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d723ba41f80 x1873908077775744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787098312 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098312.852871:0:3308:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787098302/real 1787098302] req@ffff8d7241a82d80 x1873908077775616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787098312 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098312.852885:0:3308:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d7241a82d80 x1873908077775616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787098312 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787098312.852903:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787098312.852913:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787098312.852917:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077775744:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787098312.852924:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d72417a4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787098312.852929:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787098312.852932:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077775616:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787098312.860219:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787098312.860226:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787098312.860230:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d72417a4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787098312.860239:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:2.0:1787098312.860246:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787098312.860254:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d72417a4000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1787098312.860296:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723ba40a80 x1873908077779328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787098312.860318:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787098312.860322:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787098312.860325:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787098312.860329:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:2.0:1787098312.860333:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787098312.860338:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d723b573800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1787098312.860340:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077779200:0@lo:400:kworker.0 00000100:00100000:2.0:1787098312.860351:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723ba43b80 x1873908077779456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787098312.860398:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077779584:0@lo:400:kworker.0 00000100:00100000:1.0:1787098312.860417:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098312.860456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098312.860537:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077779584 00000100:00100000:2.0:1787098312.860546:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077779584 00000100:00100000:2.0:1787098312.860608:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787098312.860618:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077779584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098312.860666:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077779584:12345-0@lo:400:kworker.0 Request processed in 50us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098312.860679:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787098312.860729:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d723ba43480 x1873908077779584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098312.860742:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077779584:0@lo:400:kworker.0 00000100:00100000:2.0:1787098312.860762:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077779328:0@lo:8:kworker.0 00000400:00000100:2.0:1787098312.860787:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873908077779328 offset 0 length 520: 4 00000100:00100000:2.0:1787098312.860805:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077779456:0@lo:8:kworker.0 00000400:00000100:2.0:1787098312.860837:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873908077779456 offset 0 length 520: 4 00000100:00100000:3.0:1787098312.861175:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077779200 00000100:00100000:3.0:1787098312.861180:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077779200 00000100:00100000:3.0:1787098312.861221:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787098312.861230:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:3312:x1873908077779200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098312.861276:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+12:3312:x1873908077779200:12345-0@lo:400:kworker.0 Request processed in 48us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098312.861303:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787098312.861566:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077779200:0@lo:400:kworker.0 00010000:00010000:2.0:1787098313.487534:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098314.512440:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787098314.617491:0:15166:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787098314.617495:0:15166:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787098314.617642:0:15166:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d7203e35800 00000020:01000004:3.0:1787098314.617659:0:15166:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787098314.617671:0:15166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787098314.617684:0:15166:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d72057919c0) 00000020:00000080:3.0:1787098314.617705:0:15166:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787098314.639097:0:15166:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787098314.639505:0:15166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787098314.640393:0:15166:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787098314.640726:0:15166:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787098314.640941:0:15166:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787098314.641495:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 371: rc = 0 00100000:10000000:2.0:1787098314.641598:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 371: rc = 0 00100000:10000000:2.0:1787098314.641765:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 371: rc = 0 00100000:10000000:2.0:1787098314.642476:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 457: rc = 0 00100000:10000000:2.0:1787098314.642847:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 457: rc = 0 00100000:10000000:2.0:1787098314.643077:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 457: rc = 0 00100000:10000000:2.0:1787098314.646946:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 457: rc = 0 00100000:10000000:2.0:1787098314.647273:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 457: rc = 0 00100000:10000000:2.0:1787098314.649089:0:15166:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 457: rc = 0 00000020:00000080:2.0:1787098314.649849:0:15166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787098314.649860:0:15166:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787098314.649871:0:15166:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1d871f9b01457b1 00000020:01000004:2.0:1787098314.649879:0:15166:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787098314.649900:0:15166:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787098314.649904:0:15166:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787098314.649910:0:15166:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787098314.649914:0:15166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787098314.649925:0:15166:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d7208e119c0) 00000020:00000080:2.0:1787098314.649934:0:15166:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787098314.651119:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098314.651322:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787098314.651329:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787098314.661112:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787098314.661136:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787098314.668222:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787098314.668236:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787098314.671917:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787098314.672855:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787098314.672866:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787098314.677152:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787098314.677261:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787098314.724221:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787098314.728105:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787098314.728121:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787098314.730646:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787098314.730666:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787098314.741217:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787098314.741342:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787098314.743124:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787098314.743376:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787098314.743384:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787098314.758148:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787098314.758166:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787098314.802012:0:15166:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787098314.802230:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787098314.802247:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787098314.803706:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787098314.803717:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787098314.809652:0:15166:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787098314.809692:0:15166:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787098314.809698:0:15166:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787098314.819604:0:15166:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787098314.819827:0:15166:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787098314.819832:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787098314.819834:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787098314.819835:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098314.819836:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787098314.819838:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098314.819839:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098314.819841:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787098314.819843:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098314.819844:0:15166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787098314.819848:0:15166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787098314.819850:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787098314.819851:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787098314.819852:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787098314.819853:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787098314.819855:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787098314.819856:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787098314.819857:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787098314.819858:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787098314.819859:0:15166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787098314.819888:0:15166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787098314.819909:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077779712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787098314.819985:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.824866:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077779712 00000100:00100000:0.0:1787098314.824898:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077779712 00000100:00100000:0.0:1787098314.824964:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787098314.824974:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+12:15166:x1873908077779712:12345-0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787098314.825068:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66c00 going to sleep for 11 seconds 20000000:01000000:2.0:1787098314.825211:0:14477:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787098314.825216:0:14477:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787098314.825220:0:14477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787098314.833870:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+12:15166:x1873908077779712:12345-0@lo:253:mount.lustre.0 Request processed in 8886us (13873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098314.833886:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000040:00080000:2.0:1787098314.834773:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787098314.835102:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077779712:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787098314.835119:0:15166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787098314.835123:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787098314.835125:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787098314.835126:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787098314.835128:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787098314.835129:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787098314.835130:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787098314.835132:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787098314.835134:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787098314.835135:0:15166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787098314.835160:0:15166:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d7203e35800 from lustre-OST0000 10000000:01000000:3.0:1787098314.835183:0:15166:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787098314.835186:0:15166:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787098314.835193:0:15166:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d72065eb380 local copy 00010000:00010000:3.0:1787098314.835204:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098314.835827:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077779840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787098314.835886:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098314.835933:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203e13f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787098314.836016:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077779840 00000100:00100000:2.0:1787098314.836022:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077779840 00000100:00100000:2.0:1787098314.836112:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787098314.836122:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+12:15166:x1873908077779840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098314.836493:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+12:15166:x1873908077779840:12345-0@lo:501:mount.lustre.0 Request processed in 372us (606us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787098314.836501:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787098314.836575:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077779840:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787098314.836595:0:15166:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787098314.836830:0:15166:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787098314.836838:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.836848:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098314.836876:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d7203e35800 10000000:01000000:0.0:1787098314.836881:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787098314.836886:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d72065eb380 10000000:01000000:0.0:1787098314.836888:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787098314.836891:0:15166:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8d72065eb380 from 1 10000000:01000000:0.0:1787098314.836894:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787098314.836922:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695600/0xb1d871f9b01457bf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.836929:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208695600/0xb1d871f9b01457bf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.836939:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208695600/0xb1d871f9b01457bf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098314.836968:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077779968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787098314.837006:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.837096:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720625ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787098314.837144:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077779968 00000100:00100000:2.0:1787098314.837150:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077779968 00000100:00100000:2.0:1787098314.837238:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787098314.837245:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+12:15166:x1873908077779968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787098314.837254:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098314.837268:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227623200/0xb1d871f9b01457c6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01457bf expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.837319:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227623200/0xb1d871f9b01457c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01457bf expref: 13 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.837329:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227623200/0xb1d871f9b01457c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01457bf expref: 13 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.837337:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227623200, rc 0) 00000100:00100000:2.0:1787098314.837377:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+13:15166:x1873908077779968:12345-0@lo:101:mount.lustre.0 Request processed in 133us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098314.837383:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787098314.837462:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077779968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787098314.837476:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208695600/0xb1d871f9b01457bf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457c6 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.837484:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208695600/0xb1d871f9b01457bf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01457c6 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098314.837500:0:15166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787098314.837515:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695600/0xb1d871f9b01457bf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457c6 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.837522:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208695600/0xb1d871f9b01457bf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457c6 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098314.837528:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787098314.837532:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787098314.837537:0:15166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787098314.837539:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787098314.837563:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01457cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.837572:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01457cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.837579:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01457cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098314.837598:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787098314.837626:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.837924:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720625ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098314.838004:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077780096 00000100:00100000:3.0:1787098314.838010:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077780096 00000100:00100000:3.0:1787098314.838039:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787098314.838045:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+13:15166:x1873908077780096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787098314.838063:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098314.838075:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200031a00/0xb1d871f9b01457d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01457cd expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.838093:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200031a00/0xb1d871f9b01457d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01457cd expref: 14 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.838102:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200031a00/0xb1d871f9b01457d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01457cd expref: 14 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.838109:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200031a00, rc 0) 00000100:00100000:3.0:1787098314.838152:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780096:12345-0@lo:101:mount.lustre.0 Request processed in 106us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098314.838159:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787098314.838268:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787098314.838309:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01457cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457d4 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.838319:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01457cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01457d4 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787098314.839102:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787098314.841021:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787098314.841396:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787098314.841442:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787098314.841471:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787098314.841531:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787098314.841581:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787098314.841614:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787098314.841904:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787098314.841915:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787098314.842019:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787098314.842090:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.842178:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720625e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098314.842321:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077780224 00000100:00100000:1.0:1787098314.842328:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077780224 00000100:00100000:3.0:1787098314.842621:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787098314.842636:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787098314.843156:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780224:12345-0@lo:501:mount.lustre.0 Request processed in 524us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098314.843165:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787098314.843505:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098314.843642:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780352:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787098314.843766:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098314.843841:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72403b2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098314.843889:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077780352 00000100:00100000:3.0:1787098314.843894:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077780352 00000100:00100000:3.0:1787098314.845620:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787098314.845645:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780352:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787098314.846095:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780352:12345-0@lo:503:mount.lustre.0 Request processed in 461us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098314.846103:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787098314.846778:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780352:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787098314.847870:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787098314.847960:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780480:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787098314.848032:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098314.848123:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72403b2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098314.848212:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077780480 00000100:00100000:3.0:1787098314.848228:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077780480 00000100:00100000:3.0:1787098314.848292:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787098314.848302:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787098314.848512:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780480:12345-0@lo:502:mount.lustre.0 Request processed in 212us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098314.848520:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787098314.848635:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787098314.848879:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787098314.848935:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787098314.848982:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787098314.849035:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787098314.849075:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787098314.849108:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787098314.849152:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787098314.849190:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787098314.849227:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787098314.849269:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787098314.849357:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787098314.849401:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787098314.849441:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787098314.849496:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098314.849527:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098314.849726:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077780608 00000100:00100000:3.0:1787098314.849733:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077780608 00000100:00100000:3.0:1787098314.849770:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787098314.849779:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787098314.849959:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780608:12345-0@lo:502:mount.lustre.0 Request processed in 181us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098314.849967:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787098314.850077:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787098314.850154:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787098314.850164:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787098314.851775:0:15180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787098314.851786:0:15180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787098314.851793:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.851802:0:15180:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787098314.851810:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787098314.851826:0:15180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d7208e14d40) 00000020:00000080:2.0:1787098314.851851:0:15180:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787098314.851858:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787098314.851918:0:15180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7203e35800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787098314.851927:0:15180:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787098314.851936:0:15180:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb1d871f9b01457e2 00010000:00010000:2.0:1787098314.861574:0:15180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787098314.862150:0:15180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787098314.867461:0:15180:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787098314.871364:0:15180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787098314.871377:0:15180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098314.871384:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.871386:0:15180:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787098314.871390:0:15180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787098314.871393:0:15180:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1787098314.871394:0:15180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787098314.871396:0:15180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787098314.871398:0:15180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787098314.871400:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.871402:0:15180:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787098314.871405:0:15180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098314.871407:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.871409:0:15180:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787098314.871411:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787098314.871413:0:15180:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787098314.871415:0:15180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098314.871417:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.871418:0:15180:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787098314.871420:0:15180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098314.871423:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.871424:0:15180:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787098314.871427:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787098314.871505:0:15180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098314.871509:0:15180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.871510:0:15180:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787098314.871514:0:15180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787098314.871703:0:15166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787098314.871735:0:15166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787098314.871757:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01457cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457d4 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098314.871768:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208695400/0xb1d871f9b01457cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457d4 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098314.871776:0:15166:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7203e35800 from 1 10000000:01000000:1.0:1787098314.871778:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787098314.871810:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098314.871819:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098314.871837:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098314.871864:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780736:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787098314.871930:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098314.871973:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098314.872034:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077780736 00000100:00100000:3.0:1787098314.872043:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077780736 00000100:00100000:3.0:1787098314.872100:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787098314.872109:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+14:15166:x1873908077780736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787098314.872123:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098314.872137:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01457e9 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.872161:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01457e9 expref: 15 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.872171:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01457e9 expref: 15 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.872180:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7200030c00, rc 0) 00000100:00100000:3.0:1787098314.872228:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077780736:12345-0@lo:101:mount.lustre.0 Request processed in 120us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098314.872234:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787098314.872343:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787098314.872358:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098314.872367:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787098314.873097:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787098314.873908:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787098314.874184:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787098314.874230:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787098314.876590:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787098314.876614:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787098314.877588:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787098314.877799:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098314.877843:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787098314.879715:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077780864 00000100:00100000:0.0:1787098314.879728:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077780864 00000100:00100000:0.0:1787098314.879788:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787098314.879810:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077780864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787098314.880117:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077780864:12345-0@lo:501:mount.lustre.0 Request processed in 307us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098314.880125:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787098314.882517:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098314.882919:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780992:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787098314.883000:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098314.883044:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720133a300 going to sleep for 11 seconds 00000100:00100000:1.0:1787098314.884453:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077780992 00000100:00100000:1.0:1787098314.884466:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077780992 00000100:00100000:1.0:1787098314.884518:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787098314.884527:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077780992:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787098314.884907:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077780992:12345-0@lo:503:mount.lustre.0 Request processed in 380us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098314.884922:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787098314.886753:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077780992:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787098314.887377:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787098314.889217:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781120:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787098314.889329:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098314.890602:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203e13f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098314.892611:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077781120 00000100:00100000:1.0:1787098314.892625:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077781120 00000100:00100000:1.0:1787098314.892783:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787098314.892794:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077781120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787098314.893072:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077781120:12345-0@lo:502:mount.lustre.0 Request processed in 279us (3742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098314.893079:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787098314.893739:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787098314.894187:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787098314.894367:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787098314.894541:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787098314.894595:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787098314.897131:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787098314.897226:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787098314.897258:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787098314.897309:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787098314.897357:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787098314.897442:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098314.897485:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7203e13f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787098314.897763:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077781248 00000100:00100000:0.0:1787098314.897773:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077781248 00000100:00100000:0.0:1787098314.897818:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787098314.897827:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077781248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787098314.898026:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077781248:12345-0@lo:502:mount.lustre.0 Request processed in 198us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098314.898033:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787098314.898090:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781248:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787098314.898190:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787098314.898200:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787098314.901169:0:15184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098314.901186:0:15184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.901188:0:15184:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787098314.901206:0:15184:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7203e35800 00000020:00000080:2.0:1787098314.901210:0:15184:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787098314.901217:0:15184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098314.901219:0:15184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.901220:0:15184:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787098314.901223:0:15184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098314.901225:0:15184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.901226:0:15184:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787098314.901229:0:15184:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7203e35800 00000020:00000080:2.0:1787098314.901231:0:15184:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787098314.905412:0:15184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098314.905425:0:15184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.905428:0:15184:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787098314.905433:0:15184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098314.905438:0:15184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.905440:0:15184:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787098314.905444:0:15184:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d7203e35800 00000020:00000080:2.0:1787098314.905447:0:15184:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787098314.905547:0:15184:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098314.905563:0:15184:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098314.905565:0:15184:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787098314.905582:0:15184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787098314.912383:0:15166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787098314.912430:0:15166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787098314.918350:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.918371:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098314.918606:0:15166:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787098314.918610:0:15166:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d7203e35800 10000000:01000000:0.0:1787098314.918614:0:15166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d7203e35800 10000000:01000000:0.0:1787098314.918617:0:15166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787098314.918625:0:15166:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d7203e35800 from 1 10000000:01000000:0.0:1787098314.918633:0:15166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787098314.918679:0:15166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01457f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.918689:0:15166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01457f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.918703:0:15166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01457f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098314.918734:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787098314.918801:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.918843:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204d7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787098314.918878:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077781376 00000100:00100000:0.0:1787098314.918885:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077781376 00000100:00100000:0.0:1787098314.918929:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787098314.918938:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077781376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787098314.918951:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098314.918964:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7208695200/0xb1d871f9b01457fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b01457f7 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.918987:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7208695200/0xb1d871f9b01457fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b01457f7 expref: 16 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.919015:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7208695200/0xb1d871f9b01457fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01457f7 expref: 16 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.919023:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7208695200, rc 0) 00000100:00100000:0.0:1787098314.919061:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077781376:12345-0@lo:101:mount.lustre.0 Request processed in 124us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098314.919076:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787098314.919128:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787098314.919140:0:15166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01457f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457fe expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.919149:0:15166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01457f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b01457fe expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787098314.923445:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787098314.923948:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787098314.924193:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787098314.924239:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787098314.924270:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787098314.924351:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787098314.924389:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787098314.924435:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787098314.924471:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787098314.924503:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787098314.924548:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787098314.924610:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787098314.924637:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787098314.925417:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787098314.925450:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787098314.925478:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787098314.925519:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787098314.926047:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787098314.926097:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787098314.926161:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787098314.926214:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787098314.926265:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787098314.926352:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787098314.926388:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787098314.926420:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787098314.926463:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787098314.926499:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787098314.926533:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787098314.926595:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787098314.926633:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787098314.926732:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787098314.926740:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787098314.926844:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787098314.926912:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.926965:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204d7de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098314.927351:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077781504 00000100:00100000:3.0:1787098314.927360:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077781504 00000100:00100000:3.0:1787098314.927412:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787098314.927422:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077781504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787098314.927688:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077781504:12345-0@lo:501:mount.lustre.0 Request processed in 267us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098314.927697:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787098314.928373:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787098314.928421:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787098314.928468:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.928498:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077781632 00000100:00100000:0.0:1787098314.928502:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077781632 00000100:00100000:0.0:1787098314.928542:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787098314.928559:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077781632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787098314.928709:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077781632:12345-0@lo:503:mount.lustre.0 Request processed in 159us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098314.928716:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787098314.928757:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204d7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787098314.928769:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781632:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787098314.931976:0:15166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787098314.932081:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787098314.932166:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.932215:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077781760 00000100:00100000:0.0:1787098314.932221:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077781760 00000100:00100000:0.0:1787098314.932265:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787098314.932274:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077781760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787098314.932984:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077781760:12345-0@lo:502:mount.lustre.0 Request processed in 707us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098314.932993:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787098314.933160:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204d7de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787098314.933185:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781760:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787098314.933587:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787098314.933641:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787098314.933906:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787098314.933973:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787098314.934012:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787098314.934058:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787098314.934091:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787098314.934122:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787098314.934183:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787098314.934324:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787098314.934360:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787098314.934408:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787098314.934446:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787098314.934481:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787098314.934532:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787098314.934582:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787098314.934615:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787098314.934665:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787098314.935848:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787098314.935917:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787098314.936122:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787098314.936158:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787098314.936182:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787098314.936219:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787098314.936245:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787098314.936268:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787098314.936333:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787098314.936364:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787098314.936390:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787098314.936428:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787098314.936461:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787098314.936494:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787098314.936525:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787098314.936577:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787098314.938571:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787098314.938765:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787098314.938881:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787098314.938912:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787098314.938956:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787098314.938987:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787098314.939102:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787098314.939181:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.939443:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204d7de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787098314.939566:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077781888 00000100:00100000:2.0:1787098314.939575:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077781888 00000100:00100000:2.0:1787098314.939675:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787098314.939685:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077781888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787098314.939934:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077781888:12345-0@lo:502:mount.lustre.0 Request processed in 250us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098314.939943:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787098314.940048:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077781888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787098314.940139:0:15166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787098314.940155:0:15166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787098314.944607:0:15189:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787098314.944624:0:15189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d724192b380) 00000020:00000080:0.0:1787098314.944644:0:15189:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787098314.945370:0:15189:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7203e35800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787098314.945375:0:15189:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7203e35800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787098314.945378:0:15189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7203e35800 3 00010000:00080000:0.0:1787098314.945409:0:15189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7227471000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1787098314.952201:0:15189:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787098314.952348:0:15189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787098314.952389:0:15189:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787098314.952402:0:15189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb1d871f9b014580c 00000100:00080000:0.0:1787098314.952412:0:15189:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787098314.952418:0:15189:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d7227471000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1787098314.952456:0:15189:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723ba02300 x1873908077782016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787098314.952487:0:15189:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787098314.952511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787098314.952515:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787098314.952518:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1787098314.952521:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1873908077782016:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787098314.952521:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787098314.952572:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077782144:0@lo:400:kworker.0 00000100:00100000:0.0:1787098314.957517:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098314.957800:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077782144 00000100:00100000:2.0:1787098314.957809:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077782144 00000100:00100000:3.0:1787098314.957823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098314.957850:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077782016 00000100:00100000:2.0:1787098314.957853:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077782016 00000100:00100000:2.0:1787098314.957866:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787098314.957873:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787098314.957875:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077782144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098314.957880:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787098314.957935:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077782144:12345-0@lo:400:kworker.0 Request processed in 61us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098314.957943:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098314.957961:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787098314.957965:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1873908077782016:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787098314.957987:0:14483:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:2.0:1787098314.958026:0:14483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb1d871f9b0145813 00000004:00100000:2.0:1787098314.958040:0:14483:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787098314.958071:0:14483:0:(import.c:65:import_set_state_nolock()) ffff8d723d3b8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787098314.958117:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873908077782016:12345-0@lo:38:llog_process_th.0 Request processed in 150us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098314.958124:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787098314.958314:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d723ba02300 x1873908077782016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787098324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787098314.958325:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787098314.958333:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787098314.958340:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787098314.958344:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787098314.958347:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7227471000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787098314.958352:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1873908077782016:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787098314.959136:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d723ba01880 x1873908077782144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098314.959150:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077782144:0@lo:400:kworker.0 00000040:00080000:2.0:1787098314.959474:0:15189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787098314.959643:0:15166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787098314.960010:0:15166:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787098314.960033:0:15166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01457f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457fe expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.960045:0:15166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7208695a00/0xb1d871f9b01457f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01457fe expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787098314.960103:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787098314.960105:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787098314.960106:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098314.960107:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098314.960109:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098314.960110:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098314.960111:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098314.960113:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098314.960114:0:15166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787098314.960119:0:15166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787098314.960121:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787098314.960122:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787098314.960123:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098314.960124:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098314.960125:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098314.960126:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098314.960127:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098314.960128:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098314.960129:0:15166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787098314.960151:0:15166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787098314.960169:0:15166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077782272:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787098314.960232:0:15166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098314.960298:0:15166:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7204d7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787098314.961505:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077782272 00000100:00100000:3.0:1787098314.961517:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077782272 00000100:00100000:3.0:1787098314.961577:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787098314.961587:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15166:x1873908077782272:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787098314.961620:0:14478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787098314.961635:0:14478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787098314.996824:0:14478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787098314.996847:0:14478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787098314.997261:0:14499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787098314.997267:0:14499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787098314.997311:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.997331:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145780 expref: 16 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.997340:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.997402:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0145780 expref: 16 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098314.997416:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0145780 expref: 16 pid: 14477 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098314.997431:0:14499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a83480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14499:1873908077782400:0@lo:104: 00000100:00100000:3.0:1787098314.997493:0:14499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098314.997537:0:14499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72324ec780 going to sleep for 11 seconds 00000100:00100000:0.0:1787098314.997844:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077782400 00000100:00100000:0.0:1787098314.997852:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077782400 00000100:00100000:0.0:1787098314.997900:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098314.997910:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+3:14499:x1873908077782400:12345-0@lo:104: 00010000:00010000:0.0:1787098314.997922:0:14467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098314.997978:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787098314.997983:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+3:14499:x1873908077782400:12345-0@lo:104: Request processed in 76us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098314.998000:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098314.998040:0:14499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a83480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14499:1873908077782400:0@lo:104: 00010000:00010000:0.0:1787098314.998061:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.998743:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098314.998751:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.998760:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694200 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:2.0:1787098314.998763:0:14472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.998772:0:14472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787098314.998779:0:14472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098314.998785:0:14472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787098314.998819:0:14472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.998826:0:14472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787098314.998850:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.998856:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7208694200/0xb1d871f9b0145780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145787 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.998873:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098314.998875:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098314.998877:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098314.998889:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787098314.998900:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077782528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787098314.998956:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098314.999009:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077782528 00000100:00100000:2.0:1787098314.999014:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077782528 00010000:00010000:2.0:1787098314.999039:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0145780 expref: 17 pid: 14477 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098314.999065:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787098314.999073:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:3312:x1873908077782528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098314.999084:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098314.999090:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0145780 expref: 17 pid: 14477 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999100:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0145780 expref: 17 pid: 14477 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999115:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7208694600/0xb1d871f9b0145787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0145780 expref: 17 pid: 14477 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999128:0:14470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999135:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787098314.999149:0:14470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003360205s 00010000:00010000:2.0:1787098314.999153:0:14470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999160:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999177:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999183:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999189:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098314.999193:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999200:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999214:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999224:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098314.999256:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc79daaf-8bf3-4a07-a406-566e9526a151+16:3312:x1873908077782528:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098314.999264:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787098314.999352:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077782528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098314.999382:0:14499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999395:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098314.999401:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200030200/0xb1d871f9b014581a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098315.004015:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+15:15166:x1873908077782272:12345-0@lo:253:mount.lustre.0 Request processed in 42421us (43773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098315.004031:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787098315.004143:0:15166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15166:1873908077782272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787098315.004159:0:15166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787098315.004162:0:15166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787098315.004164:0:15166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787098315.004165:0:15166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098315.004167:0:15166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098315.004168:0:15166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098315.004170:0:15166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098315.004171:0:15166:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098315.004173:0:15166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098315.004175:0:15166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787098315.004191:0:15166:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787098315.016595:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098315.016736:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787098315.016860:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098315.016987:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787098315.017129:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787098315.017534:0:15166:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787098315.018522:0:15166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787098315.059724:0:15166:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787098315.059745:0:15166:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787098315.059780:0:15166:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787098315.059833:0:15166:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787098315.059851:0:15166:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787098315.059878:0:15166:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787098315.535507:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787098316.303373:0:14480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787098316.303381:0:14480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d72417b6800 from 7 10000000:01000000:3.0:1787098316.303387:0:14480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787098316.303437:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098316.303449:0:14480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098316.303546:0:14480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098316.303576:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077782656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787098316.303662:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098316.303719:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72324ec180 going to sleep for 11 seconds 00000100:00100000:2.0:1787098316.303780:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077782656 00000100:00100000:2.0:1787098316.303788:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077782656 00000100:00100000:2.0:1787098316.303846:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787098316.303856:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+15:14480:x1873908077782656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098316.303867:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098316.303882:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0145821 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098316.303905:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0145821 expref: 16 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098316.303914:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145821 expref: 16 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098316.303923:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622400, rc 0) 00000100:00100000:2.0:1787098316.303979:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+16:14480:x1873908077782656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098316.303985:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787098316.304034:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a83b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077782656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098316.304048:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098316.304056:0:14480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098316.304113:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077782784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787098316.304150:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098316.304165:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787098316.304179:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077782784 00000100:00100000:2.0:1787098316.304183:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077782784 00000100:00100000:3.0:1787098316.304323:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787098316.304333:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:14480:x1873908077782784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787098316.304348:0:14477:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787098316.304365:0:14477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787098316.304373:0:14477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787098316.304450:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:14480:x1873908077782784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098316.304542:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787098316.304654:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077782784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787098316.304707:0:14480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787098316.304715:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098316.304724:0:14480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098316.560938:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098317.586907:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098318.607499:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098319.635485:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787098320.015618:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787098320.015626:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787098320.015629:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787098320.015632:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787098320.015688:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787098320.015708:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc79daaf-8bf3-4a07-a406-566e9526a151:3311:1873908077782912:0@lo:400:kworker.0 00000100:00100000:3.0:1787098320.015782:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098320.016049:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077782912 00000100:00100000:3.0:1787098320.016056:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077782912 00000100:00100000:3.0:1787098320.016100:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787098320.016109:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:3311:x1873908077782912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098320.016160:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:3311:x1873908077782912:12345-0@lo:400:kworker.0 Request processed in 51us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098320.016168:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787098320.016219:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc79daaf-8bf3-4a07-a406-566e9526a151:3311:1873908077782912:0@lo:400:kworker.0 00000100:00100000:0.0:1787098320.016511:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077783040:0@lo:400:kworker.0 00000100:00100000:0.0:1787098320.016549:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098320.016592:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098320.016598:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077783168:0@lo:400:kworker.0 00000100:00100000:0.0:1787098320.016622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098320.016802:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077783040 00000100:00100000:0.0:1787098320.016806:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077783040 00000100:00100000:0.0:1787098320.016832:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077783168 00000100:00100000:0.0:1787098320.016834:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077783168 00000100:00100000:0.0:1787098320.016865:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098320.016871:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077783040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098320.016909:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077783040:12345-0@lo:400:kworker.0 Request processed in 38us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098320.016929:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098320.016942:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787098320.016948:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077783168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098320.016976:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077783168:12345-0@lo:400:kworker.0 Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098320.016981:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787098320.017008:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787098320.017029:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7241a80700 x1873908077783168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098320.017042:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077783168:0@lo:400:kworker.0 00010000:00080000:0.0:1787098320.017051:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7241a82300 x1873908077783040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098320.017060:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077783040:0@lo:400:kworker.0 00010000:00010000:3.0:1787098320.658990:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787098320.925013:0:15535:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787098321.685263:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098322.706450:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098323.732408:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787098324.049219:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787098324.751574:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787098325.138957:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787098325.138964:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787098325.138967:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787098325.138970:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787098325.139018:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077783424:0@lo:400:kworker.0 00000100:00100000:2.0:1787098325.139093:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098325.139155:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787098325.139162:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077783296:0@lo:400:kworker.0 00000100:00100000:2.0:1787098325.139192:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098325.139227:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077783552:0@lo:400:kworker.0 00000100:00100000:2.0:1787098325.139258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098325.139335:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077783424 00000100:00100000:2.0:1787098325.139346:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077783424 00000100:00100000:2.0:1787098325.139423:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077783552 00000100:00100000:2.0:1787098325.139427:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077783552 00000100:00100000:2.0:1787098325.139464:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098325.139474:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077783424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098325.139532:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077783424:12345-0@lo:400:kworker.0 Request processed in 59us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098325.139540:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098325.139557:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787098325.139564:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077783552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098325.139593:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873908077783552:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098325.139600:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787098325.139695:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077783296 00000100:00100000:2.0:1787098325.139700:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077783296 00000100:00100000:2.0:1787098325.139725:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787098325.139731:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+16:3312:x1873908077783296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098325.139841:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+16:3312:x1873908077783296:12345-0@lo:400:kworker.0 Request processed in 110us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098325.139849:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1787098325.139881:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787098325.139913:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ba43800 x1873908077783552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098325.139928:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1873908077783552:0@lo:400:kworker.0 00000100:00100000:2.0:1787098325.139953:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077783296:0@lo:400:kworker.0 00010000:00080000:2.0:1787098325.139963:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ba43100 x1873908077783424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098325.139984:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077783424:0@lo:400:kworker.0 00010000:00010000:1.0:1787098325.782392:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098326.807948:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098327.183421:0:3308:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787098312/real 1787098312] req@ffff8d723ba40a80 x1873908077779328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787098327 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098327.183455:0:3308:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d723ba40a80 x1873908077779328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787098327 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098327.183466:0:3308:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787098312/real 1787098312] req@ffff8d723ba43b80 x1873908077779456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787098327 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098327.183477:0:3308:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d723ba43b80 x1873908077779456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787098327 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787098327.183498:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d72417a4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787098327.183531:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787098327.183536:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077779328:0@lo:8:kworker.0 00000100:00080000:1.0:1787098327.183541:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787098327.183546:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787098327.183548:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077779456:0@lo:8:kworker.0 00000100:00080000:0.0:1787098327.183809:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787098327.183814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787098327.183818:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d72417a4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787098327.183823:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:0.0:1787098327.183828:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787098327.183836:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d72417a4000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1787098327.183855:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723ba03800 x1873908077783808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787098327.183880:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787098327.183884:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787098327.183899:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787098327.183903:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:0.0:1787098327.183905:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787098327.183909:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d723b573800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1787098327.183921:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d723ba01180 x1873908077783936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787098327.183959:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077784064:0@lo:400:kworker.0 00000100:00100000:0.0:1787098327.183970:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077784192:0@lo:400:kworker.0 00000100:00100000:2.0:1787098327.184047:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc79daaf-8bf3-4a07-a406-566e9526a151:3310:1873908077783680:0@lo:400:kworker.0 00000100:00100000:3.0:1787098327.186410:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098327.186593:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077783808:0@lo:8:kworker.0 00000100:00100000:3.0:1787098327.186651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098327.186682:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077783936:0@lo:8:kworker.0 00000100:00100000:3.0:1787098327.186732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098327.186790:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077783808 00000100:00100000:3.0:1787098327.186799:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077783808 00000100:00100000:3.0:1787098327.186827:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077783936 00000100:00100000:3.0:1787098327.186830:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077783936 00000100:00100000:3.0:1787098327.186844:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098327.186851:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1873908077783808:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787098327.186881:0:15167:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:3.0:1787098327.186919:0:15167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b014582f 00002000:00100000:3.0:1787098327.186936:0:15167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d72098c5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787098327.186941:0:15167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787098327.186944:0:15167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787098327.186964:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098327.187016:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077784064 00000100:00100000:0.0:1787098327.187021:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077784064 00000100:00100000:0.0:1787098327.187060:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077784192 00000100:00100000:0.0:1787098327.187063:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077784192 00000100:00100000:0.0:1787098327.187167:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787098327.187177:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077784064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098327.187240:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077784064:12345-0@lo:400:kworker.0 Request processed in 66us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098327.187248:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787098327.187263:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787098327.187270:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077784192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098327.187398:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077784192:12345-0@lo:400:kworker.0 Request processed in 128us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098327.187405:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787098327.187434:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787098327.187463:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ba00700 x1873908077784192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098327.187477:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077784192:0@lo:400:kworker.0 00000100:00100000:2.0:1787098327.188390:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787098327.188586:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ba02680 x1873908077784064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098327.188599:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077784064:0@lo:400:kworker.0 00002000:00080000:3.0:1787098327.188670:0:15167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1787098327.188692:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077783680 00000100:00100000:0.0:1787098327.188700:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077783680 00000100:00080000:3.0:1787098327.188706:0:15167:0:(import.c:65:import_set_state_nolock()) ffff8d72098c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098327.188746:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787098327.188755:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+16:3310:x1873908077783680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098327.188804:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+16:3310:x1873908077783680:12345-0@lo:400:kworker.0 Request processed in 51us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098327.188812:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787098327.188864:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1873908077783808:12345-0@lo:8:kworker.0 Request processed in 2011us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098327.188874:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098327.188893:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787098327.188908:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc79daaf-8bf3-4a07-a406-566e9526a151:3310:1873908077783680:0@lo:400:kworker.0 00000100:00100000:3.0:1787098327.188911:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1873908077783936:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787098327.188930:0:15167:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787098327.188961:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1873908077783936:12345-0@lo:8:kworker.0 Request processed in 52us (2228us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787098327.188967:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787098327.189036:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ba03800 x1873908077783808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787098347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098327.189115:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787098327.189123:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787098327.189131:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787098327.189135:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787098327.189137:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d72417a4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787098327.189169:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787098327.189175:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077783808:0@lo:8:kworker.0 00000100:00080000:1.0:1787098327.189192:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787098327.189196:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787098327.189199:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077783936:0@lo:8:kworker.0 00000004:00080000:2.0:1787098327.189338:0:14505:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787098327.189714:0:14505:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425445433314ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787098327.189847:0:14506:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787098327.189868:0:14506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14506:1873908077784448:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787098327.189885:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077784320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098327.189913:0:14506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098327.189929:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098327.189941:0:14506:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209ee5300 going to sleep for 11 seconds 00000100:00100000:0.0:1787098327.189969:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077784448 00000100:00100000:0.0:1787098327.189973:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077784448 00000100:00100000:0.0:1787098327.190012:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098327.190020:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14506:x1873908077784448:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1787098327.190308:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098327.193941:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077784320 00000100:00100000:2.0:1787098327.193954:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077784320 00000100:00100000:2.0:1787098327.194014:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787098327.194034:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873908077784320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787098327.194076:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098327.194161:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873908077784320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (4232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098327.194168:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787098327.194370:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d723ba01f80 x1873908077784320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098327.194395:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077784320:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1787098327.199350:0:15169:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787098327.199363:0:15169:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787098327.199368:0:15169:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1787098327.213601:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.213617:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213636:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.213641:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.213648:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213675:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213686:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213694:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213715:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787098327.213730:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098327.213736:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213745:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098327.213750:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213760:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213777:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213785:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b0145836 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.213809:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.213811:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.213812:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.214392:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.214400:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214410:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.214414:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.214418:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214429:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214437:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214444:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214461:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787098327.214471:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098327.214475:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214494:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098327.214497:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214505:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214517:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214524:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b014583d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.214537:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.214539:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.214541:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.219442:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.219459:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219479:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.219484:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.219500:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219514:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219532:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219540:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219558:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787098327.219831:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098327.219839:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219848:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098327.219853:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219861:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219880:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219886:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b0145844 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.219909:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.219918:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.219919:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.220736:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.220745:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220757:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.220761:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.220766:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220778:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220788:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220795:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220816:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787098327.220828:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098327.220833:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220841:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098327.220844:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220866:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220880:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220888:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b014584b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.220908:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.220909:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.220911:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.221383:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.221390:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221398:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.221401:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.221405:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221414:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221433:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221446:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221461:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787098327.221470:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098327.221474:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221481:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694e00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098327.221484:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221503:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221515:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221521:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145852 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.221536:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.221539:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.221540:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.224954:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.224980:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225001:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.225007:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.225014:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225032:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225044:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225052:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225074:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787098327.225087:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098327.225094:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225103:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098327.225107:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225117:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225144:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225152:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b0145859 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.225177:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.225180:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.225181:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.226391:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.226400:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.226414:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.228964:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.228984:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.229007:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.229020:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.229027:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.229062:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098327.229241:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098327.229249:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.229256:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098327.229260:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.229297:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.229339:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.229348:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b0145860 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.229371:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.229373:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.229374:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.230873:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.230883:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.230898:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.230902:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.230906:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.230917:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.230926:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.230934:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.230954:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787098327.230965:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098327.230970:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.230978:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098327.230988:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.230997:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.231011:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.231019:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145867 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.231036:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.231037:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.231039:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.234862:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.234881:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.234903:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.234909:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.234916:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.234932:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.234945:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.234960:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.234993:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787098327.235905:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098327.235981:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.235993:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098327.235999:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.236008:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.236030:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.236037:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b014586e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.236063:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098327.236065:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098327.236067:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.238142:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.238156:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.238174:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.238178:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.238184:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.238197:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.238207:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.238214:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.238240:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098327.239081:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098327.239091:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.239101:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098327.239106:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.239115:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.239134:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.239154:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b0145875 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.239178:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.239179:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.239181:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.242456:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.242469:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.244119:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.244126:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.244135:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.244154:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.244167:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.244175:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.244201:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787098327.247018:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.247030:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.247046:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.247051:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.247056:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.247071:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.247091:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.247099:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.247116:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787098327.248950:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787098327.248964:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.248978:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098327.248984:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.248995:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.249016:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.249025:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b014587c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.249044:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098327.249048:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.249067:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098327.249071:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.249078:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.249089:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.249095:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b0145883 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.249108:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.249110:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.249111:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.249118:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.250245:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.250255:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.250272:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.250276:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.250305:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.250330:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.250340:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.250348:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.250380:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787098327.251130:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.251137:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.251147:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.251151:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098327.251152:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098327.251155:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.251160:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.251165:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.251168:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098327.251173:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.251173:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.251182:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.251183:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.251197:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787098327.251200:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.251206:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098327.251218:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b014588a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.251238:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.251240:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.251242:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.253572:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.253578:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.253580:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.253647:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.253664:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694e00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098327.253670:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.253679:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.253699:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.253706:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f941d5c/0xb1d871f9b0145891 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.253728:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.253729:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.253731:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.255275:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.256219:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.256239:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.256255:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.256262:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.257181:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.257200:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.257209:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.257237:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787098327.257345:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098327.257364:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.257373:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098327.257378:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.257389:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.257538:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.257547:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006feebad5/0xb1d871f9b0145898 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.257572:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.257574:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.257575:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.259106:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.259118:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.259137:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.259142:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.259148:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.259166:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.259177:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.259195:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.259225:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098327.259723:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098327.259732:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.259742:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098327.259746:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.259764:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.259784:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.259792:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8ef80b/0xb1d871f9b014589f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.259816:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.259818:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.259819:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.260183:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.260189:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.260199:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.260202:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.260208:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.260217:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.260224:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.260230:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.260252:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787098327.261204:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.261213:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.261230:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.261233:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.261237:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.261248:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.261256:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.261262:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.261369:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1787098327.261662:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787098327.262512:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.262521:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.262533:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.262537:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.262541:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.262552:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.262567:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.262723:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.265806:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787098327.265821:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.265851:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098327.265855:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.265865:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.265887:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.265894:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b2c0e0/0xb1d871f9b01458a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266062:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787098327.266069:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266076:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098327.266080:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266102:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266115:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266122:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9cc8a08/0xb1d871f9b01458ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266222:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098327.266227:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266234:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098327.266236:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266243:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266252:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.266259:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.266261:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.266268:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.266514:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.266517:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.266519:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.266602:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787098327.266611:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011930005/0xb1d871f9b01458b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.267159:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.267272:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.267564:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.267579:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.267584:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.267590:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.267603:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.267612:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.267633:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.267841:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787098327.268339:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.268345:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.268355:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.268359:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.268364:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.268375:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.268383:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.268389:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268697:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787098327.268706:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268719:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098327.268724:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268734:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268751:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268758:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc00afa4/0xb1d871f9b01458bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.268763:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787098327.268780:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098327.268784:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268792:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098327.268795:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268803:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268819:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268827:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3a7640f/0xb1d871f9b01458c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.268840:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.268842:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.269161:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.269167:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.269181:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.269184:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.269188:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.269198:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.269205:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.269211:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.269498:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098327.269501:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.269503:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.269511:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098327.269514:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.269523:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.269535:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.269543:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.269544:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.269546:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.269614:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787098327.269620:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e7782fb/0xb1d871f9b01458c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.269653:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787098327.270180:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.270187:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.270196:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.270200:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.270204:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.270226:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.270235:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.270242:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.270410:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787098327.270821:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.270827:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.270836:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.270839:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.270843:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.270852:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.270859:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.270880:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271073:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787098327.271080:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271089:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098327.271094:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271115:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271131:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271140:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5463864/0xb1d871f9b01458d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271159:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098327.271163:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271171:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204ee00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098327.271174:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271180:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271188:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.271194:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.271195:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.271203:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.271335:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787098327.271342:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebb80008/0xb1d871f9b01458d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098327.272116:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.272124:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.272136:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.272141:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.272145:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.272157:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.272165:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.272172:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.272244:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098327.272256:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.272264:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098327.272268:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.272385:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.272478:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.272488:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.272490:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098327.272492:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.272579:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787098327.272585:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b01458de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098327.273034:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.273041:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.273050:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.273053:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.273058:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.273067:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.273076:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.273084:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.273120:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098327.273126:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.273134:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204f000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098327.273138:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.273147:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.273159:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.273168:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.273170:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.273171:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.273235:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787098327.273240:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030447c77/0xb1d871f9b01458e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098327.273744:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787098327.273752:0:15169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.273760:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=425s v=(0 0) 00010000:00010000:0.0:1787098327.273764:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098327.273768:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.273778:0:15169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.273787:0:15169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.273794:0:15169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.273980:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098327.273986:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.273995:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204ea00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098327.273999:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.274008:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.274033:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.274041:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.274043:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098327.274045:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098327.274159:0:15169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787098327.274165:0:15169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b01458ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.274226:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787098327.274704:0:15169:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1787098327.274847:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14506:x1873908077784448:12345-0@lo:5:osp-pre-0-0.0 Request processed in 84823us (84930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098327.274861:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787098327.275001:0:14506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14506:1873908077784448:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787098327.275018:0:14506:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787098327.275076:0:14506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14506:1873908077784576:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787098327.275114:0:14506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098327.275170:0:14506:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7207b5a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787098327.275751:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077784576 00000100:00100000:3.0:1787098327.275759:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077784576 00000100:00100000:3.0:1787098327.275814:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787098327.275823:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14506:x1873908077784576:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787098327.275868:0:15167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787098327.286141:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14506:x1873908077784576:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10312us (11019us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787098327.286161:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787098327.287008:0:14506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14506:1873908077784576:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787098327.287026:0:14506:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787098327.830110:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787098327.866651:0:15886:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787098327.866656:0:15886:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787098327.866807:0:15886:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d7204a5a800 00000020:01000004:0.0:1787098327.866835:0:15886:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787098327.866849:0:15886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787098327.866865:0:15886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d7241928000) 00000020:00000080:0.0:1787098327.866882:0:15886:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787098327.902833:0:15886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787098327.903142:0:15886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787098327.903975:0:15886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787098327.904269:0:15886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787098327.904611:0:15886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787098327.904935:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 525: rc = 0 00100000:10000000:2.0:1787098327.905025:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 525: rc = 0 00100000:10000000:2.0:1787098327.905162:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 525: rc = 0 00100000:10000000:2.0:1787098327.905583:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 391: rc = 0 00100000:10000000:2.0:1787098327.905938:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 391: rc = 0 00100000:10000000:2.0:1787098327.907345:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 391: rc = 0 00100000:10000000:2.0:1787098327.907634:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 391: rc = 0 00100000:10000000:2.0:1787098327.907899:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 391: rc = 0 00100000:10000000:2.0:1787098327.908177:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 391: rc = 0 00000020:00000080:2.0:1787098327.908947:0:15886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787098327.908965:0:15886:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787098327.908975:0:15886:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1d871f9b01458fa 00000020:01000004:2.0:1787098327.908984:0:15886:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787098327.909006:0:15886:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787098327.909010:0:15886:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787098327.909016:0:15886:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787098327.909038:0:15886:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787098327.909043:0:15886:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787098327.920696:0:15886:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787098327.920745:0:15886:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787098327.920750:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787098327.920751:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787098327.920753:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787098327.920754:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787098327.920755:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787098327.920756:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787098327.920758:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787098327.920760:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787098327.920761:0:15886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787098327.920765:0:15886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787098327.920767:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787098327.920768:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787098327.920769:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787098327.920770:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787098327.920771:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787098327.920772:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787098327.920773:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787098327.920774:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787098327.920775:0:15886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787098327.920800:0:15886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787098327.920821:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077784704:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787098327.920898:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.920963:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d3240 going to sleep for 11 seconds 00000100:00100000:3.0:1787098327.921178:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077784704 00000100:00100000:3.0:1787098327.921186:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077784704 00000100:00100000:3.0:1787098327.921245:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787098327.921254:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15886:x1873908077784704:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787098327.921336:0:14477:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787098327.921341:0:14477:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787098327.921345:0:14477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787098327.930943:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15886:x1873908077784704:12345-0@lo:253:mount.lustre.0 Request processed in 9679us (10034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098327.930973:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787098327.931161:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077784704:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787098327.931177:0:15886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787098327.931194:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787098327.931196:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787098327.931198:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787098327.931199:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787098327.931200:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787098327.931201:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787098327.931202:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787098327.931204:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787098327.931206:0:15886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787098327.931230:0:15886:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d7204a5a800 from lustre-OST0001 10000000:01000000:2.0:1787098327.931269:0:15886:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787098327.931272:0:15886:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787098327.931357:0:15886:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d72065eb380 local copy 00010000:00010000:2.0:1787098327.931368:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098327.931668:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077784832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098327.931712:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.931794:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098327.931836:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077784832 00000100:00100000:0.0:1787098327.931842:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077784832 00000100:00100000:0.0:1787098327.931930:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787098327.931940:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15886:x1873908077784832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787098327.932097:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15886:x1873908077784832:12345-0@lo:501:mount.lustre.0 Request processed in 158us (384us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787098327.932105:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787098327.932161:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077784832:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787098327.932175:0:15886:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787098327.932379:0:15886:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787098327.932386:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.932395:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413800/0xb1d871f9b01456a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b01456ae expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098327.932430:0:15886:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d7204a5a800 10000000:01000000:2.0:1787098327.932436:0:15886:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787098327.932441:0:15886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787098327.932449:0:15886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787098327.932454:0:15886:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787098327.932457:0:15886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787098327.932481:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227623c00/0xb1d871f9b0145901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.932488:0:15886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227623c00/0xb1d871f9b0145901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.932497:0:15886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227623c00/0xb1d871f9b0145901 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098327.932511:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077784960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787098327.932541:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.932783:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098327.932855:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077784960 00000100:00100000:3.0:1787098327.932861:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077784960 00000100:00100000:3.0:1787098327.932888:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787098327.932895:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+16:15886:x1873908077784960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787098327.932904:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098327.932917:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0145908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0145901 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.932938:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0145908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0145901 expref: 17 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.932948:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c6a00/0xb1d871f9b0145908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145901 expref: 17 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098327.932955:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6a00, rc 0) 00000100:00100000:3.0:1787098327.932994:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077784960:12345-0@lo:101:mount.lustre.0 Request processed in 99us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098327.933000:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787098327.933084:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077784960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787098327.933097:0:15886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227623c00/0xb1d871f9b0145901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145908 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.933105:0:15886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227623c00/0xb1d871f9b0145901 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145908 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787098327.933824:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787098327.934781:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787098327.935055:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787098327.935101:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787098327.935137:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787098327.935198:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787098327.935238:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787098327.935274:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787098327.935402:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787098327.935410:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787098327.935500:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098327.935567:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.935607:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787098327.935798:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077785088 00000100:00100000:3.0:1787098327.935806:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077785088 00000100:00100000:3.0:1787098327.935845:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787098327.935854:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077785088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787098327.936213:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077785088:12345-0@lo:501:mount.lustre.0 Request processed in 359us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098327.936221:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787098327.936548:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098327.936588:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787098327.936636:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.936707:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787098327.936768:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077785216 00000100:00100000:1.0:1787098327.936773:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077785216 00000100:00100000:3.0:1787098327.936822:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787098327.936831:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077785216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787098327.937591:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077785216:12345-0@lo:503:mount.lustre.0 Request processed in 758us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098327.937601:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787098327.937791:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785216:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787098327.938695:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787098327.938774:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787098327.938840:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.938943:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787098327.938984:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077785344 00000100:00100000:3.0:1787098327.938990:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077785344 00000100:00100000:3.0:1787098327.939084:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787098327.939095:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077785344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787098327.939362:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f218850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077785344:12345-0@lo:502:mount.lustre.0 Request processed in 269us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098327.939370:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787098327.939534:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787098327.939780:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787098327.939831:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787098327.939866:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787098327.939925:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787098327.939960:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787098327.939990:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787098327.940046:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787098327.940079:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787098327.940120:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787098327.940151:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787098327.940197:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.940363:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787098327.940604:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077785472 00000100:00100000:1.0:1787098327.940611:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077785472 00000100:00100000:1.0:1787098327.940643:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787098327.940650:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077785472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787098327.940871:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f219050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077785472:12345-0@lo:502:mount.lustre.0 Request processed in 220us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098327.940885:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787098327.941033:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787098327.941114:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787098327.941124:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787098327.942090:0:15887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787098327.942101:0:15887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787098327.942109:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098327.942111:0:15887:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787098327.942117:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787098327.942133:0:15887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d723bac4d40) 00000020:00000080:1.0:1787098327.942157:0:15887:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787098327.942163:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787098327.942224:0:15887:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7204a5a800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787098327.942232:0:15887:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787098327.942240:0:15887:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb1d871f9b0145916 00010000:00010000:1.0:1787098327.946200:0:15887:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787098327.947718:0:15887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787098327.949727:0:15887:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787098327.951214:0:15887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787098327.951226:0:15887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098327.951232:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098327.951234:0:15887:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787098327.951237:0:15887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098327.951241:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098327.951242:0:15887:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787098327.951245:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787098327.951247:0:15887:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787098327.951249:0:15887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098327.951251:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098327.951252:0:15887:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787098327.951254:0:15887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787098327.951256:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098327.951258:0:15887:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787098327.951260:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787098327.951361:0:15887:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787098327.951371:0:15887:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787098327.951372:0:15887:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787098327.951376:0:15887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787098327.951602:0:15886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787098327.951629:0:15886:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787098327.951653:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227623c00/0xb1d871f9b0145901 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145908 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.951665:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227623c00/0xb1d871f9b0145901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145908 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787098327.951674:0:15886:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7204a5a800 from 1 10000000:01000000:2.0:1787098327.951676:0:15886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787098327.951711:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.951718:0:15886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.951732:0:15886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098327.951761:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787098327.951830:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.951904:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787098327.953827:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077785600 00000100:00100000:1.0:1787098327.953845:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077785600 00000100:00100000:1.0:1787098327.953908:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787098327.953918:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f21bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+17:15886:x1873908077785600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787098327.953934:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098327.953952:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014591d expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.953981:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014591d expref: 18 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.953992:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014591d expref: 18 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.954001:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413c00, rc 0) 00000100:00100000:1.0:1787098327.954070:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f21bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077785600:12345-0@lo:101:mount.lustre.0 Request processed in 153us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098327.954077:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787098327.954184:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787098327.954202:0:15886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098327.954224:0:15886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787098327.954848:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787098327.955147:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787098327.959389:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787098327.959657:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787098327.959749:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787098327.959758:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787098327.959873:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098327.959947:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.959999:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d3000 going to sleep for 11 seconds 00000100:00100000:3.0:1787098327.960058:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077785728 00000100:00100000:3.0:1787098327.960067:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077785728 00000100:00100000:3.0:1787098327.960127:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787098327.960137:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077785728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787098327.960604:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f218050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077785728:12345-0@lo:501:mount.lustre.0 Request processed in 467us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098327.960614:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787098327.961322:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098327.961368:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787098327.961534:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098327.961566:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7d3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787098327.961628:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077785856 00000100:00100000:0.0:1787098327.961635:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077785856 00000100:00100000:0.0:1787098327.961679:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787098327.961689:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077785856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787098327.961912:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f21a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077785856:12345-0@lo:503:mount.lustre.0 Request processed in 223us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098327.961920:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787098327.962016:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785856:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787098327.965041:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787098327.965145:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787098327.965803:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098327.965885:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abf900 going to sleep for 11 seconds 00000100:00100000:0.0:1787098327.965926:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077785984 00000100:00100000:0.0:1787098327.965944:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077785984 00000100:00100000:0.0:1787098327.966021:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787098327.966032:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077785984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787098327.966275:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077785984:12345-0@lo:502:mount.lustre.0 Request processed in 244us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098327.966343:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787098327.966452:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077785984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787098327.966693:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787098327.966755:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787098327.966807:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787098327.966846:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787098327.966900:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787098327.966953:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787098327.966988:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787098327.967025:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787098327.967058:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787098327.967110:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098327.967651:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abf900 going to sleep for 11 seconds 00000100:00100000:2.0:1787098327.967718:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077786112 00000100:00100000:2.0:1787098327.967724:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077786112 00000100:00100000:2.0:1787098327.967760:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787098327.967768:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077786112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787098327.968005:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077786112:12345-0@lo:502:mount.lustre.0 Request processed in 236us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098327.968012:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787098327.968145:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787098327.968255:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787098327.968267:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787098327.969581:0:15891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098327.969594:0:15891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098327.969597:0:15891:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787098327.969611:0:15891:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7204a5a800 00000020:00000080:2.0:1787098327.969615:0:15891:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787098327.969623:0:15891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098327.969626:0:15891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098327.969628:0:15891:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787098327.969630:0:15891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098327.969633:0:15891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098327.969634:0:15891:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787098327.969638:0:15891:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7204a5a800 00000020:00000080:2.0:1787098327.969640:0:15891:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787098327.969699:0:15891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098327.969703:0:15891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098327.969705:0:15891:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787098327.969707:0:15891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787098327.969710:0:15891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098327.969711:0:15891:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787098327.969715:0:15891:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d7204a5a800 00000020:00000080:2.0:1787098327.969717:0:15891:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787098327.969754:0:15891:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787098327.969758:0:15891:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787098327.969759:0:15891:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787098327.969762:0:15891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787098327.973241:0:15886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787098327.973311:0:15886:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787098327.976623:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.976645:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787098327.976804:0:15886:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787098327.976809:0:15886:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d7204a5a800 10000000:01000000:0.0:1787098327.976813:0:15886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d7204a5a800 10000000:01000000:0.0:1787098327.976818:0:15886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787098327.976824:0:15886:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8d7204a5a800 from 1 10000000:01000000:0.0:1787098327.976827:0:15886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787098327.976869:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014592b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.976878:0:15886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014592b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.976890:0:15886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014592b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098327.976917:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787098327.976990:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098327.977047:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209256180 going to sleep for 11 seconds 00000100:00100000:1.0:1787098327.978558:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077786240 00000100:00100000:1.0:1787098327.978575:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077786240 00000100:00100000:1.0:1787098327.978642:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787098327.978652:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240323050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077786240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787098327.978669:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098327.978690:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b014592b expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.978736:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b014592b expref: 19 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.978750:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227412c00/0xb1d871f9b0145932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014592b expref: 19 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098327.978759:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412c00, rc 0) 00000100:00100000:1.0:1787098327.978835:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240323050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077786240:12345-0@lo:101:mount.lustre.0 Request processed in 185us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098327.978842:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787098327.979573:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786240:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787098327.979596:0:15886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014592b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145932 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098327.979608:0:15886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014592b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145932 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787098327.980341:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787098327.982004:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787098327.982338:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787098327.982385:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787098327.985115:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787098327.985243:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787098327.986033:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787098327.986112:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787098327.986151:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787098327.986183:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787098327.986256:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787098327.986341:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787098327.986376:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787098327.987646:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787098327.987710:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787098327.987744:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787098327.989816:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787098327.989860:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787098327.989887:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787098327.989925:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787098327.989953:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787098327.989993:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787098327.990034:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787098327.990072:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787098327.990106:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787098327.990155:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787098327.990184:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787098327.990210:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787098327.990247:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787098327.990275:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787098327.990350:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787098327.990489:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787098327.990525:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787098327.990554:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787098327.990587:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787098327.990634:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787098327.990671:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787098327.990739:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787098327.990776:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787098327.990869:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787098327.990876:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787098327.990990:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786368:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787098327.991066:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098327.991125:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7209256180 going to sleep for 11 seconds 00000100:00100000:2.0:1787098327.991564:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077786368 00000100:00100000:2.0:1787098327.991573:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077786368 00000100:00100000:2.0:1787098327.991626:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787098327.991635:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240321050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077786368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787098327.991865:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240321050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077786368:12345-0@lo:501:mount.lustre.0 Request processed in 230us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098327.991873:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787098327.993499:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787098327.993561:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787098327.993633:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098327.993681:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077786496 00000100:00100000:1.0:1787098327.993688:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077786496 00000100:00100000:1.0:1787098327.993751:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787098327.993759:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077786496:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787098327.993937:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077786496:12345-0@lo:503:mount.lustre.0 Request processed in 177us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098327.993944:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787098327.993991:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098327.994003:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786496:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787098327.994570:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787098327.994635:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787098327.994688:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098327.994723:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098327.996548:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077786624 00000100:00100000:0.0:1787098327.996563:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077786624 00000100:00100000:0.0:1787098327.996620:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787098327.996630:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240322450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077786624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787098327.996891:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240322450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077786624:12345-0@lo:502:mount.lustre.0 Request processed in 262us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098327.996900:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787098327.997565:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787098327.997849:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787098327.997915:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787098327.997952:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787098327.998005:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787098327.998045:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787098327.998094:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787098327.998156:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787098327.998195:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787098327.998247:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787098327.998331:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787098327.998371:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787098328.001338:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787098328.002579:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787098328.002642:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787098328.002713:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787098328.002756:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787098328.002795:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787098328.002849:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787098328.002887:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787098328.002920:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787098328.004767:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787098328.004856:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787098328.004908:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787098328.005127:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787098328.005173:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787098328.005210:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787098328.005262:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787098328.005569:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787098328.005627:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787098328.005705:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787098328.005748:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787098328.005784:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787098328.005818:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787098328.005868:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787098328.005905:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787098328.005956:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787098328.005993:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787098328.006027:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787098328.006096:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787098328.006134:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787098328.007719:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787098328.007806:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098328.007912:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241abf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787098328.007962:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077786752 00000100:00100000:0.0:1787098328.007970:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077786752 00000100:00100000:0.0:1787098328.008058:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787098328.008068:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077786752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787098328.008576:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077786752:12345-0@lo:502:mount.lustre.0 Request processed in 507us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098328.008585:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787098328.008670:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077786752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787098328.008785:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787098328.008801:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787098328.009760:0:15896:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787098328.009774:0:15896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d723bac0000) 00000020:00000080:1.0:1787098328.009795:0:15896:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787098328.009970:0:15896:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7204a5a800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787098328.009974:0:15896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7204a5a800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787098328.009977:0:15896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7204a5a800 3 00010000:00080000:1.0:1787098328.010003:0:15896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7105e99000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1787098328.014187:0:15896:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787098328.015766:0:15896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787098328.015826:0:15896:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787098328.015841:0:15896:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb1d871f9b0145940 00000100:00080000:1.0:1787098328.015853:0:15896:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787098328.015869:0:15896:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d7105e99000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1787098328.015908:0:15896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7106020000 x1873908077786880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787098328.015972:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1873908077786880:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787098328.016059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787098328.016510:0:15896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787098328.016559:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787098328.016564:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787098328.016567:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787098328.016571:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:1.0:1787098328.016576:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787098328.016580:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d723b573800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1787098328.016596:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7106020a80 x1873908077787136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787098328.016655:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077787136:0@lo:8:kworker.0 00000100:00100000:0.0:1787098328.016688:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098328.016728:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077786880 00000100:00100000:0.0:1787098328.016735:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077786880 00000100:00100000:0.0:1787098328.016765:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787098328.016773:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1873908077786880:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787098328.016799:0:14485:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1787098328.016838:0:14485:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb1d871f9b0145947 00000004:00100000:0.0:1787098328.016853:0:14485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787098328.016886:0:14485:0:(import.c:65:import_set_state_nolock()) ffff8d7105ed2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098328.016935:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873908077786880:12345-0@lo:38:llog_process_th.0 Request processed in 161us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098328.016944:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787098328.016984:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7106020000 x1873908077786880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787098338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098328.016994:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787098328.017004:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787098328.017012:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787098328.017016:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787098328.017018:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d7105e99000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787098328.017025:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1873908077786880:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787098328.017577:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077787008:0@lo:400:kworker.0 00000100:00100000:1.0:1787098328.017619:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098328.017666:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077787136 00000100:00100000:1.0:1787098328.017671:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077787136 00000100:00100000:1.0:1787098328.017691:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077787008 00000100:00100000:1.0:1787098328.017694:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077787008 00000100:00100000:1.0:1787098328.017719:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787098328.017726:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1873908077787008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098328.017769:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1873908077787008:12345-0@lo:400:kworker.0 Request processed in 43us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098328.017775:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787098328.017788:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787098328.017792:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1873908077787136:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787098328.017826:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1873908077787136:12345-0@lo:8:kworker.0 Request processed in 32us (1138us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787098328.017840:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787098328.017870:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077787008:0@lo:400:kworker.0 00000100:00100000:0.0:1787098328.017959:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077787392:0@lo:400:kworker.0 00000100:00100000:0.0:1787098328.017989:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098328.018021:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787098328.018033:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077787264:0@lo:400:kworker.0 00000100:00100000:0.0:1787098328.018058:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098328.018091:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077787392 00000100:00100000:0.0:1787098328.018095:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077787392 00000100:00100000:0.0:1787098328.018119:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077787264 00000100:00100000:0.0:1787098328.018122:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077787264 00000100:00100000:0.0:1787098328.018139:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787098328.018145:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077787392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098328.018181:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1873908077787392:12345-0@lo:400:kworker.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098328.018187:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787098328.018199:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787098328.018204:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077787264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098328.018230:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1873908077787264:12345-0@lo:400:kworker.0 Request processed in 26us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098328.018237:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787098328.019560:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7106022d80 x1873908077787264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098328.019576:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1873908077787264:0@lo:400:kworker.0 00010000:00080000:0.0:1787098328.019587:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7106021f80 x1873908077787392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787098328.019595:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1873908077787392:0@lo:400:kworker.0 00000100:00100000:0.0:1787098328.019637:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787098328.019643:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787098328.019647:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787098328.019658:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077787136:0@lo:8:kworker.0 00000040:00080000:1.0:1787098328.020373:0:15896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787098328.021961:0:15886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787098328.021995:0:15886:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787098328.022022:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014592b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145932 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098328.022035:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204f000/0xb1d871f9b014592b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145932 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787098328.022109:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787098328.022111:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787098328.022112:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098328.022114:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098328.022116:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098328.022117:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098328.022118:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098328.022121:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098328.022122:0:15886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787098328.022126:0:15886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787098328.022128:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787098328.022129:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787098328.022130:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787098328.022132:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787098328.022132:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787098328.022134:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787098328.022134:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787098328.022135:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787098328.022136:0:15886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787098328.022162:0:15886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787098328.022181:0:15886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077787520:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787098328.022246:0:15886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098328.022316:0:15886:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72209df000 going to sleep for 11 seconds 00000100:00100000:2.0:1787098328.022545:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077787520 00000100:00100000:2.0:1787098328.022553:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077787520 00000100:00100000:2.0:1787098328.022631:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787098328.022648:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240322c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+19:15886:x1873908077787520:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787098328.022675:0:14478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787098328.022690:0:14478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787098328.066764:0:14478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787098328.066794:0:14478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787098328.066935:0:14499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787098328.066941:0:14499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787098328.066985:0:14499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098328.067007:0:14499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145821 expref: 19 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098328.067015:0:14499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098328.067157:0:14499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b0145821 expref: 19 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098328.067174:0:14499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b0145821 expref: 19 pid: 14475 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098328.067192:0:14499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14499:1873908077787648:0@lo:104: 00000100:00100000:1.0:1787098328.074907:0:14499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098328.074976:0:14499:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d722018e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787098328.075117:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077787648 00000100:00100000:3.0:1787098328.075130:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077787648 00000100:00100000:3.0:1787098328.075193:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787098328.075204:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+3:14499:x1873908077787648:12345-0@lo:104: 00010000:00010000:3.0:1787098328.075229:0:14466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.075342:0:14466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098328.075373:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+3:14499:x1873908077787648:12345-0@lo:104: Request processed in 171us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098328.075380:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787098328.075624:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098328.075632:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.075641:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7200030200 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098328.075645:0:14472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.075654:0:14472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098328.075662:0:14472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098328.075669:0:14472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787098328.075710:0:14472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.075717:0:14472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098328.075735:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.075742:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7200030200/0xb1d871f9b0145821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145828 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.075761:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098328.075763:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098328.075765:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098328.075889:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077787776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787098328.075934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098328.076006:0:14499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14499:1873908077787648:0@lo:104: 00010000:00010000:1.0:1787098328.076104:0:14499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098328.076167:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077787776 00000100:00100000:3.0:1787098328.076172:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077787776 00010000:00010000:3.0:1787098328.076193:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0145821 expref: 20 pid: 14475 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098328.076233:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787098328.076241:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc79daaf-8bf3-4a07-a406-566e9526a151+20:3309:x1873908077787776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787098328.076253:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098328.076259:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b0145821 expref: 20 pid: 14475 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076271:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b0145821 expref: 20 pid: 14475 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076388:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227622400/0xb1d871f9b0145828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b0145821 expref: 20 pid: 14475 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076414:0:14470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076423:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787098328.076440:0:14470:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009498950s 00010000:00010000:3.0:1787098328.076444:0:14470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076452:0:14470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076460:0:14470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076475:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076482:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098328.076486:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076494:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076515:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098328.076525:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098328.076563:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3309:x1873908077787776:12345-0@lo:103:ldlm_bl.0 Request processed in 322us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098328.076570:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787098328.078645:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077787776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098328.078723:0:14499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098328.078734:0:14499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098328.078741:0:14499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204e200/0xb1d871f9b014594e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098328.088341:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240322c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+18:15886:x1873908077787520:12345-0@lo:253:mount.lustre.0 Request processed in 65686us (66085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098328.088357:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787098328.088551:0:15886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dc79daaf-8bf3-4a07-a406-566e9526a151:15886:1873908077787520:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787098328.088569:0:15886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787098328.088573:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787098328.088574:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787098328.088576:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787098328.088577:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787098328.088579:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787098328.088580:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787098328.088582:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787098328.088583:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787098328.088585:0:15886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787098328.088606:0:15886:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787098328.106530:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098328.107653:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787098328.107832:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098328.111632:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787098328.111976:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787098328.112210:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787098328.115682:0:15886:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787098328.238512:0:15886:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787098328.238523:0:15886:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787098328.238573:0:15886:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787098328.238642:0:15886:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787098328.238657:0:15886:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787098328.238690:0:15886:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787098328.848559:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787098329.424506:0:14480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787098329.424514:0:14480:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8d72417b6800 from 8 10000000:01000000:0.0:1787098329.424520:0:14480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787098329.424567:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f600/0xb1d871f9b0145955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098329.424580:0:14480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d724204f600/0xb1d871f9b0145955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098329.424592:0:14480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d724204f600/0xb1d871f9b0145955 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098329.424619:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077787904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787098329.424688:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098329.424749:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72031863c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098329.424762:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077787904 00000100:00100000:2.0:1787098329.424770:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077787904 00000100:00100000:2.0:1787098329.424829:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787098329.424838:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:14480:x1873908077787904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098329.424852:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098329.424878:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227622e00/0xb1d871f9b014595c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0145955 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098329.424902:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227622e00/0xb1d871f9b014595c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0145955 expref: 19 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098329.424913:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227622e00/0xb1d871f9b014595c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145955 expref: 19 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098329.424922:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227622e00, rc 0) 00000100:00100000:2.0:1787098329.424964:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:14480:x1873908077787904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098329.424972:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787098329.425145:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077787904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098329.425162:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d724204f600/0xb1d871f9b0145955 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014595c expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098329.425171:0:14480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d724204f600/0xb1d871f9b0145955 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b014595c expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098329.425222:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077788032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787098329.425255:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098329.425310:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72031863c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098329.429302:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077788032 00000100:00100000:2.0:1787098329.429315:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077788032 00000100:00100000:2.0:1787098329.429367:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787098329.429376:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240322850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+19:14480:x1873908077788032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787098329.429406:0:14478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787098329.429424:0:14478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787098329.429427:0:14478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787098329.429560:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240322850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+19:14480:x1873908077788032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 184us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098329.429567:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787098329.431424:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077788032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787098329.431504:0:14480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787098329.431514:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d724204f600/0xb1d871f9b0145955 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014595c expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098329.431527:0:14480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d724204f600/0xb1d871f9b0145955 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b014595c expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098329.871459:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787098330.865902:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787098330.865920:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787098330.895905:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098331.920334:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098332.306174:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098332.306198:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077788160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098332.306323:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098332.306501:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077788160 00000100:00100000:0.0:1787098332.306514:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077788160 00000100:00100000:0.0:1787098332.306573:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787098332.306583:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077788160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098332.306617:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098332.306674:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077788160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098332.306681:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787098332.306703:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098332.306738:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787098332.306762:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077788160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787098332.951248:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787098333.327499:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787098333.327508:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787098333.327513:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1787098333.327525:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc79daaf-8bf3-4a07-a406-566e9526a151:3311:1873908077788288:0@lo:400:kworker.0 00000100:00080000:1.0:1787098333.327527:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d723b573800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1787098333.327556:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d7106020a80 x1873908077788544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787098333.327616:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077788416:0@lo:400:kworker.0 00000100:00100000:2.0:1787098333.328546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098333.328679:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077788288 00000100:00100000:3.0:1787098333.328695:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077788288 00000100:00100000:3.0:1787098333.328758:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787098333.328768:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3311:x1873908077788288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098333.331027:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098333.331038:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077788928:0@lo:400:kworker.0 00000100:00100000:2.0:1787098333.331087:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098333.331091:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077788544:0@lo:8:kworker.0 00000100:00100000:1.0:1787098333.331120:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098333.331129:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077788800:0@lo:400:kworker.0 00000100:00100000:1.0:1787098333.331154:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077788672:0@lo:400:kworker.0 00000100:00100000:2.0:1787098333.331156:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098333.331180:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098333.331217:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077788928 00000100:00100000:2.0:1787098333.331227:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077788928 00000100:00100000:1.0:1787098333.331241:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077788416 00000100:00100000:1.0:1787098333.331244:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077788416 00000100:00100000:1.0:1787098333.331308:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077788544 00000100:00100000:1.0:1787098333.331312:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077788544 00000100:00100000:2.0:1787098333.331318:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077788800 00000100:00100000:2.0:1787098333.331321:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077788800 00000100:00100000:1.0:1787098333.331328:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098333.331336:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077788672 00000100:00100000:2.0:1787098333.331339:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077788672 00000100:00100000:1.0:1787098333.331349:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077788416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098333.331353:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787098333.331359:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077788928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098333.331409:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077788928:12345-0@lo:400:kworker.0 Request processed in 49us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098333.331409:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077788416:12345-0@lo:400:kworker.0 Request processed in 60us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098333.331418:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787098333.331418:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098333.331435:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787098333.331435:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787098333.331439:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1873908077788544:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787098333.331441:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077788800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098333.331470:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077788800:12345-0@lo:400:kworker.0 Request processed in 30us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098333.331476:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787098333.331480:0:15169:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 431 last 0 00000100:00100000:2.0:1787098333.331487:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787098333.331492:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077788672:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1787098333.331519:0:15169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb1d871f9b0145963 00000100:00100000:2.0:1787098333.331530:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873908077788672:12345-0@lo:400:kworker.0 Request processed in 37us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098333.331535:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00002000:00100000:1.0:1787098333.331537:0:15169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d7105e9e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113901 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787098333.331542:0:15169:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787098333.331545:0:15169:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1787098333.331558:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:1.0:1787098333.331971:0:15169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787098333.332002:0:15169:0:(import.c:65:import_set_state_nolock()) ffff8d7105e98000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098333.332052:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1873908077788544:12345-0@lo:8:kworker.0 Request processed in 610us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098333.332059:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787098333.332081:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7106022d80 x1873908077788800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787098333.332093:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7106020a80 x1873908077788544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787098358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098333.332097:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106022d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077788800:0@lo:400:kworker.0 00000100:00080000:1.0:1787098333.332105:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787098333.332114:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787098333.332120:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787098333.332123:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d723b573800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00080000:2.0:1787098333.332129:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7106021f80 x1873908077788672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787098333.332137:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873908077788672:0@lo:400:kworker.0 00000004:00080000:1.0:1787098333.332154:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787098333.332160:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1873908077788544:0@lo:8:kworker.0 00000004:00080000:2.0:1787098333.332182:0:14508:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787098333.332187:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077789056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098333.332212:0:14508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14508:1873908077789184:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787098333.332234:0:14508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098333.332234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098333.332267:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077788416:0@lo:400:kworker.0 00000100:00100000:1.0:1787098333.332324:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077789056 00000100:00100000:1.0:1787098333.332329:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077789056 00000100:00100000:1.0:1787098333.332366:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787098333.332374:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873908077789056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098333.332398:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098333.332435:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1873908077789056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098333.332441:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787098333.332467:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d723ba42680 x1873908077789056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787098349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098333.332483:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077789056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098333.332536:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077789184 00000100:00100000:2.0:1787098333.332540:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077789184 00000004:00080000:0.0:1787098333.332568:0:14507:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787098333.332572:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787098333.332579:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14508:x1873908077789184:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787098333.332995:0:14507:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431588713967ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787098333.335355:0:14508:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72324eca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098333.336115:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3311:x1873908077788288:12345-0@lo:400:kworker.0 Request processed in 7339us (7565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098333.336132:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1787098333.337512:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7106020000 x1873908077788928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787098349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787098333.337533:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106020000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077788928:0@lo:400:kworker.0 00000100:00100000:1.0:1787098333.337548:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc79daaf-8bf3-4a07-a406-566e9526a151:3311:1873908077788288:0@lo:400:kworker.0 00000100:00080000:2.0:1787098333.340952:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787098333.343079:0:15167:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787098333.343094:0:15167:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787098333.343101:0:15167:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1787098333.352598:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.352615:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352655:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.352660:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.352670:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352693:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352705:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352714:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352738:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098333.352756:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098333.352764:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352772:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098333.352777:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352787:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352822:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352830:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b014596a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.352850:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.352852:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.352855:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.353437:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.353444:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353454:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.353458:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.353462:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353472:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353480:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353487:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353515:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098333.353526:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098333.353531:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353539:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098333.353543:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353551:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353642:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353651:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c628a7d/0xb1d871f9b0145971 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.353667:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.353669:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.353671:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.354105:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.354112:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.354121:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.354130:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.354135:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.354146:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.354154:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.354160:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.354200:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787098333.354402:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098333.354408:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.354427:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098333.354431:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.354439:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.354453:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.354461:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed894c9/0xb1d871f9b0145978 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.354477:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098333.354478:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098333.354480:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.357221:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.357235:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.357257:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.357263:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.357270:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.358031:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.358048:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.358066:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.358090:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098333.358108:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098333.358115:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.358124:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098333.358129:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.358140:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.358161:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.358373:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001531c301/0xb1d871f9b014597f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.358403:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.358405:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.358407:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.361464:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.361489:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.361512:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.361518:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.361527:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.361546:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.361557:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.361566:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.361600:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787098333.361699:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098333.361708:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.361718:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098333.361723:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.361734:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.361763:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.361771:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000810114ef/0xb1d871f9b0145986 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.361794:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098333.361796:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098333.361798:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.362901:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.362913:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.362928:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.362932:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.362937:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.362951:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.362970:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.362979:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.363042:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787098333.363802:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.363810:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.363822:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.363826:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.363831:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.363843:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.363851:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.363858:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364162:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787098333.364173:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364183:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622400 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098333.364199:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364210:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364229:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364311:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d560e1c/0xb1d871f9b014598d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364349:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098333.364353:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364360:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623400 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098333.364363:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364370:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364380:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.364387:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098333.364388:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098333.364391:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.364542:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787098333.364548:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000349bb9a1/0xb1d871f9b0145994 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098333.365082:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.365089:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.365102:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.365106:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.365111:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.365123:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.365133:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.365142:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.366116:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098333.366128:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.366142:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227622000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098333.366148:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.366173:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.366706:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.366717:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098333.366719:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098333.366721:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.366902:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787098333.366912:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000785085b5/0xb1d871f9b014599b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098333.367539:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.368843:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.368856:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.368876:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.368881:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.368888:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.368905:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.368920:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.368930:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.368957:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787098333.369019:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098333.369028:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.369038:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.369043:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.369053:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.369075:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.369083:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4eaae12/0xb1d871f9b01459a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.369105:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.369107:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.369109:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.369832:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.369844:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.369858:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.369862:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.369879:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.369893:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.369903:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.369911:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.369936:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787098333.370445:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098333.370454:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.370484:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.370488:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.370503:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.370521:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.370529:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c12d85a4/0xb1d871f9b01459a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.370552:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.370554:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.370555:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.370956:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.370964:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.370976:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.370980:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.370984:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.370996:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.371004:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.371024:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.371087:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787098333.371669:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.371676:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.371688:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.371692:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.371696:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.371707:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.371716:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.371724:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.371960:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787098333.371969:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.371979:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098333.371984:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.371995:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.372013:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.372021:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3a7640f/0xb1d871f9b01459b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.372049:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787098333.372053:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.372060:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098333.372064:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.372072:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.372083:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098333.372091:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098333.372093:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098333.372095:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.372166:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787098333.372173:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc00afa4/0xb1d871f9b01459b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098333.372732:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.372739:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.372750:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.372754:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.372759:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.372769:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.372778:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.372787:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.376081:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098333.376102:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.376120:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.376126:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.376139:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.376177:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.376431:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.376433:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.376436:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.376598:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787098333.376698:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.376719:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e7782fb/0xb1d871f9b01459be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098333.378039:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.378050:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.378079:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.378084:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.378091:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.378109:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.378119:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.378128:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.378200:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787098333.378811:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.378819:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.378831:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.378834:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.378839:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.378851:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.378872:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.378881:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379005:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098333.379014:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379024:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.379029:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379038:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379059:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379067:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011930005/0xb1d871f9b01459c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379087:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098333.379091:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379105:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.379108:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379115:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379125:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379133:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.379134:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.379137:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787098333.379162:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787098333.379177:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787098333.379182:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5463864/0xb1d871f9b01459cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.379324:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.380006:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.380014:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380026:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.380030:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.380035:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380046:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380056:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380075:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380095:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098333.380107:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098333.380112:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380120:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098333.380125:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380134:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380148:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380157:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9cc8a08/0xb1d871f9b01459d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380172:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.380174:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.380175:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.380925:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.380940:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380953:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.380957:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.380962:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380974:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380983:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.380992:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381013:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098333.381024:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098333.381029:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381037:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098333.381041:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381051:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381073:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381082:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006feebad5/0xb1d871f9b01459da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381098:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.381100:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.381102:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.381549:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.381556:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381565:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.381569:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.381573:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381588:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381597:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381605:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381826:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098333.381837:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098333.381842:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381850:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694e00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098333.381854:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381864:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381877:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381886:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f941d5c/0xb1d871f9b01459e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.381899:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.381902:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.381904:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.382591:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.382600:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.382675:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.382685:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.382691:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.382704:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.382718:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.382727:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.382786:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787098333.383390:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.383396:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.383408:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.383411:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.383415:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.383426:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.383434:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.383448:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383569:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098333.383579:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383588:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208694600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.383593:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383604:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383688:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383704:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b2c0e0/0xb1d871f9b01459e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383726:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098333.383730:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383737:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7208695c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.383740:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383749:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383781:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383790:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.383792:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.383807:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787098333.383813:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c8ef80b/0xb1d871f9b01459ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.383851:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.383871:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.384954:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.384965:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.384979:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.384984:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.384988:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.385002:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.385012:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.385021:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.385094:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787098333.385840:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.385848:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.385860:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.385864:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.385868:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.385879:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.385887:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.385895:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.386010:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098333.386020:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.386030:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b37e00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.386042:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.386052:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.386071:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.386080:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072054f2e/0xb1d871f9b01459f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.386114:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787098333.386125:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787098333.386131:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.386139:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b37800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098333.386148:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.386156:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.386167:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.386174:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b80b8754/0xb1d871f9b01459fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.386209:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.386212:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.386213:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.386386:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.386388:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.386390:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.387076:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.387084:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.387099:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.387102:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.387108:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.387120:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.387129:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.387142:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.387211:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787098333.387904:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.387915:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.387925:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.387929:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.387933:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.387944:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.387953:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.387960:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388012:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098333.388020:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388029:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b36e00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.388033:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388043:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388061:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388082:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf31eacc/0xb1d871f9b0145a04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388103:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098333.388107:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388114:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b36a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.388117:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388127:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388138:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.388146:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.388147:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.388149:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.388215:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787098333.388220:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1f9c6b4/0xb1d871f9b0145a0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787098333.388911:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.388918:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.388930:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.388935:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.388939:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.388950:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.388959:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.388967:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.389205:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098333.389214:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.389223:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b37400 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.389298:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.389311:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.389325:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.389333:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.389335:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.389337:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.389420:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787098333.389426:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026eebd10/0xb1d871f9b0145a12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.389448:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.390061:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.390068:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.390089:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.390093:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.390098:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.390109:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.390118:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.390126:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.390180:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787098333.390319:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098333.390326:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.390335:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b36800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.390340:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.390349:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.390363:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.390370:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaa3bd79/0xb1d871f9b0145a19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.390394:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.390395:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.390397:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787098333.391064:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.391072:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.391084:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.391088:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.391093:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.391105:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.391125:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.391133:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.391187:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787098333.391958:0:15167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787098333.391965:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.391977:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1787098333.391980:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098333.391988:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.391998:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.392007:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098333.392015:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392423:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098333.392432:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392442:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b36200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.392447:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392466:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392484:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392497:0:15853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000496474e6/0xb1d871f9b0145a20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392515:0:15853:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098333.392519:0:15853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392527:0:15853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b37a00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098333.392538:0:15853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392547:0:15853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392557:0:15853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098333.392565:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.392567:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098333.392569:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098333.392753:0:15167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787098333.392760:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b2fd6ef/0xb1d871f9b0145a27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787098333.393051:0:15167:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1787098333.393209:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14508:x1873908077789184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 60625us (60968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098333.393222:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787098333.393365:0:14508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14508:1873908077789184:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787098333.393387:0:14508:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787098333.393451:0:14508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14508:1873908077789312:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787098333.393498:0:14508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098333.393566:0:14508:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72419696c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787098333.393649:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077789312 00000100:00100000:2.0:1787098333.393657:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077789312 00000100:00100000:2.0:1787098333.393709:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787098333.393720:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14508:x1873908077789312:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1787098333.393743:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787098333.393770:0:15170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787098333.400549:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14508:x1873908077789312:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6816us (7035us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787098333.400569:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787098333.400672:0:14508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14508:1873908077789312:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787098333.400696:0:14508:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1787098333.976646:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787098334.288074:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1787098334.939926:0:16242:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787098334.996387:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098336.018510:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787098337.039513:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098337.048055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.048176:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059970816 00000100:00100000:0.0:1787098337.048188:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059970816 00000100:00100000:0.0:1787098337.048244:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:0.0:1787098337.048253:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240320050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2372:x1873908059970816:12345-192.168.204.51@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787098337.048319:0:14477:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from 9710efb3-276e-45a2-a075-9c71c786ced4@192.168.204.51@tcp t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:0.0:1787098337.048354:0:14477:0:(genops.c:1406:class_connect()) connect: client 9710efb3-276e-45a2-a075-9c71c786ced4, cookie 0xb1d871f9b0145a2e 00000100:00080000:0.0:1787098337.048515:0:14477:0:(import.c:65:import_set_state_nolock()) ffff8d7105ed6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787098337.048598:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240320050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+5:2372:x1873908059970816:12345-192.168.204.51@tcp:250:mount.lustre.0 Request processed in 344us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.048606:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:3.0:1787098337.057917:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.058042:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059970944 00000100:00100000:0.0:1787098337.058052:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059970944 00000100:00100000:0.0:1787098337.058125:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:0.0:1787098337.058136:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7240323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+5:13794:x1873908059970944:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787098337.058152:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098337.058170:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204f400/0xb1d871f9b0145a35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287831 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.058198:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204f400/0xb1d871f9b0145a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287831 expref: 6 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.058545:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204f400/0xb1d871f9b0145a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287831 expref: 6 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.058556:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204f400, rc 0) 00000100:00100000:0.0:1787098337.058653:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7240323850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+6:13794:x1873908059970944:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 518us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.058660:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1787098337.065075:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098337.065191:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059971072 00000100:00100000:2.0:1787098337.065201:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059971072 00000100:00100000:2.0:1787098337.065316:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:2.0:1787098337.065327:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+6:13794:x1873908059971072:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787098337.065716:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+6:13794:x1873908059971072:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 389us (650us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787098337.065726:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:2.0:1787098337.071753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.071823:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059971200 00000100:00100000:0.0:1787098337.071839:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059971200 00000100:00100000:0.0:1787098337.071902:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:0.0:1787098337.071912:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+6:13794:x1873908059971200:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787098337.071928:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098337.071961:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204ec00/0xb1d871f9b0145a3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287838 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.071992:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204ec00/0xb1d871f9b0145a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287838 expref: 7 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.072003:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204ec00/0xb1d871f9b0145a3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287838 expref: 7 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.072013:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204ec00, rc 0) 00000100:00100000:0.0:1787098337.072079:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+7:13794:x1873908059971200:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 168us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.072086:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:3.0:1787098337.077623:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.078175:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059971328 00000100:00100000:0.0:1787098337.078185:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059971328 00000100:00100000:0.0:1787098337.079266:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:0.0:1787098337.079302:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+7:13794:x1873908059971328:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787098337.079657:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+8:13794:x1873908059971328:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 359us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.079666:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:3.0:1787098337.082824:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098337.083801:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059971456 00000100:00100000:2.0:1787098337.083816:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059971456 00000100:00100000:2.0:1787098337.083882:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:2.0:1787098337.083893:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+8:13794:x1873908059971456:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787098337.086299:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+8:13794:x1873908059971456:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 2374us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098337.086315:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:2.0:1787098337.095870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098337.096025:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059971584 00000100:00100000:3.0:1787098337.096036:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059971584 00000100:00100000:3.0:1787098337.096097:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:3.0:1787098337.096109:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+8:13813:x1873908059971584:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787098337.096756:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+8:13813:x1873908059971584:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 647us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098337.096766:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:3.0:1787098337.119140:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.119409:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059971712 00000100:00100000:0.0:1787098337.119419:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059971712 00000100:00100000:0.0:1787098337.119480:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:0.0:1787098337.119492:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+8:13813:x1873908059971712:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098337.119787:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+8:13813:x1873908059971712:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 296us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.119796:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:0.0:1787098337.135088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098337.135177:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059971840 00000100:00100000:2.0:1787098337.135187:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059971840 00000100:00100000:2.0:1787098337.135244:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:2.0:1787098337.135254:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+8:13794:x1873908059971840:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787098337.135274:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098337.135332:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7104b36400/0xb1d871f9b0145a43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287862 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098337.135363:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7104b36400/0xb1d871f9b0145a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287862 expref: 9 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098337.135374:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7104b36400/0xb1d871f9b0145a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287862 expref: 9 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098337.135384:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b36400, rc 0) 00000100:00100000:2.0:1787098337.135461:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+9:13794:x1873908059971840:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 208us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098337.135469:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:2.0:1787098337.141808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098337.142172:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059971968 00000100:00100000:3.0:1787098337.142183:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059971968 00000100:00100000:3.0:1787098337.142254:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:3.0:1787098337.142265:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+9:13794:x1873908059971968:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787098337.142335:0:14475:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787098337.142359:0:14475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787098337.142363:0:14475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787098337.142367:0:14475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787098337.142369:0:14475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787098337.155188:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d3b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+9:13794:x1873908059971968:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 12911us (13376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.155205:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:1.0:1787098337.160063:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098337.160320:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059972096 00000100:00100000:2.0:1787098337.160332:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059972096 00000100:00100000:2.0:1787098337.160384:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:2.0:1787098337.160394:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204f00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+9:13794:x1873908059972096:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787098337.160413:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098337.160432:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287869 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098337.160482:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287869 expref: 10 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098337.160495:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287869 expref: 10 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098337.160506:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b37200, rc 0) 00000100:00100000:2.0:1787098337.160569:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204f00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+10:13794:x1873908059972096:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 175us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098337.160576:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:2.0:1787098337.163930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.166561:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059972224 00000100:00100000:0.0:1787098337.166579:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059972224 00000100:00100000:0.0:1787098337.166726:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:0.0:1787098337.166738:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+10:13794:x1873908059972224:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787098337.167058:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+10:13794:x1873908059972224:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 321us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.167066:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:3.0:1787098337.171154:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.171772:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059972352 00000100:00100000:0.0:1787098337.171785:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059972352 00000100:00100000:0.0:1787098337.171847:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:0.0:1787098337.171857:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+10:13794:x1873908059972352:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787098337.172434:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+10:13794:x1873908059972352:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 575us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.172446:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:1.0:1787098337.176834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.177636:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059972480 00000100:00100000:0.0:1787098337.177648:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059972480 00000100:00100000:0.0:1787098337.177715:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1787098337.177725:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+10:13819:x1873908059972480:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098337.178170:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+10:13819:x1873908059972480:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 444us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.178179:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:3.0:1787098337.186061:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.186445:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059972608 00000100:00100000:0.0:1787098337.186455:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059972608 00000100:00100000:0.0:1787098337.186515:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:0.0:1787098337.186524:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+10:13819:x1873908059972608:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098337.186778:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+10:13819:x1873908059972608:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 254us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.186788:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:3.0:1787098337.195214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098337.197841:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059972736 00000100:00100000:2.0:1787098337.197855:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059972736 00000100:00100000:2.0:1787098337.197921:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:2.0:1787098337.198169:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2372:x1873908059972736:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787098337.198202:0:14483:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c@192.168.204.51@tcp t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1787098337.198454:0:14483:0:(genops.c:1406:class_connect()) connect: client 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c, cookie 0xb1d871f9b0145a51 00000004:00100000:2.0:1787098337.198491:0:14483:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787098337.198497:0:14483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787098337.252200:0:14483:0:(import.c:65:import_set_state_nolock()) ffff8d7209e22000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787098337.252443:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:2372:x1873908059972736:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 54272us (57235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098337.252455:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1787098337.255434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098337.255517:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.256346:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059972864 00000100:00100000:0.0:1787098337.256359:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059972864 00000100:00100000:0.0:1787098337.256437:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059972992 00000100:00100000:0.0:1787098337.256441:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059972992 00000100:00100000:0.0:1787098337.256469:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1787098337.256478:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:0:x1873908059972864:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787098337.256522:0:14485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787098337.256610:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:0:x1873908059972864:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 133us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.256617:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1787098337.256635:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1787098337.256642:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:13794:x1873908059972992:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787098337.256653:0:14485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787098337.256676:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:13794:x1873908059972992:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 35us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.256682:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00080000:3.0:1787098337.258712:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098337.259215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098337.259395:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059973120 00000100:00100000:0.0:1787098337.259405:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059973120 00000100:00100000:0.0:1787098337.259497:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098337.259519:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:13794:x1873908059973120:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787098337.259639:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:13794:x1873908059973120:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 121us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.259646:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1787098337.262323:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098337.262356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098337.262384:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098337.262476:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059973248 00000100:00100000:2.0:1787098337.262486:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059973248 00000100:00100000:2.0:1787098337.262525:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059973376 00000100:00100000:2.0:1787098337.262528:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059973376 00000100:00100000:2.0:1787098337.262541:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1787098337.262548:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1873908059973248:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787098337.262581:0:15167:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c@192.168.204.51@tcp t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1787098337.262620:0:15167:0:(genops.c:1406:class_connect()) connect: client 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c, cookie 0xb1d871f9b0145a58 00002000:00100000:2.0:1787098337.262632:0:15167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c/ffff8d7209e23800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787098337.262656:0:15167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787098337.263046:0:15167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787098337.263076:0:15167:0:(import.c:65:import_set_state_nolock()) ffff8d7209e24000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787098337.263158:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:2372:x1873908059973248:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 608us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098337.263167:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1787098337.263186:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1787098337.263191:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1873908059973376:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787098337.263222:0:15167:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c@192.168.204.51@tcp t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1787098337.263240:0:15167:0:(genops.c:1406:class_connect()) connect: client 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c, cookie 0xb1d871f9b0145a5f 00002000:00100000:2.0:1787098337.263245:0:15167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c/ffff8d7209e24800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787098337.263258:0:15167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787098337.263402:0:15167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787098337.263418:0:15167:0:(import.c:65:import_set_state_nolock()) ffff8d723b1c6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787098337.263442:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:2372:x1873908059973376:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 250us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098337.263449:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1787098337.264878:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059973504 00000100:00100000:1.0:1787098337.264888:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059973504 00000100:00100000:1.0:1787098337.264938:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1787098337.264947:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:13794:x1873908059973504:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787098337.265719:0:14486:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 716us 00000004:00200000:1.0:1787098337.285559:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787098337.285754:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:13794:x1873908059973504:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 20800us (23474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098337.285766:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1787098337.422396:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098337.423467:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077789440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787098337.423524:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098337.423645:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077789440 00000100:00100000:0.0:1787098337.423654:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077789440 00000100:00100000:0.0:1787098337.423714:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787098337.423722:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077789440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098337.423748:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787098337.423796:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077789440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.423803:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787098337.423884:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098337.423916:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077789440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098337.428986:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059973632 00000100:00100000:1.0:1787098337.429004:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059973632 00000100:00100000:0.0:1787098337.429204:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1787098337.429226:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:13840:x1873908059973632:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:0.0:1787098337.429248:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098337.429306:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287893 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.429378:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145a6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.429392:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145a6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.429407:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145a6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098337.429610:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787098337.429621:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098337.429728:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145a6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.429756:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287893 expref: 8 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.429774:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145a6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287893 expref: 7 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098337.429783:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d72038cde00) 00010000:00010000:0.0:1787098337.429786:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787098337.429789:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204e800, rc 0) 00000100:00100000:0.0:1787098337.430002:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:13840:x1873908059973632:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 786us (7614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098337.430010:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00010000:00010000:3.0:1787098338.064144:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787098338.448207:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787098338.448233:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077789952:0@lo:400:kworker.0 00000100:00100000:3.0:1787098338.448254:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077790080:0@lo:400:kworker.0 00000100:00100000:1.0:1787098338.448770:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077789568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787098338.450905:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077789824:0@lo:400:kworker.0 00000100:00100000:3.0:1787098338.452422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098338.453000:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098338.453736:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098338.453793:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077789824 00000100:00100000:2.0:1787098338.453804:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077789824 00000100:00100000:3.0:1787098338.453811:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077790336:0@lo:400:kworker.0 00000100:00100000:2.0:1787098338.453863:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077789952 00000100:00100000:3.0:1787098338.453869:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098338.453869:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077789952 00000100:00100000:2.0:1787098338.453913:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787098338.453925:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077789824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098338.453928:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077790080 00000100:00100000:3.0:1787098338.453936:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077790080 00000100:00100000:3.0:1787098338.453974:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077790336 00000100:00100000:3.0:1787098338.453977:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077790336 00000100:00100000:2.0:1787098338.453999:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077789824:12345-0@lo:400:kworker.0 Request processed in 76us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098338.454007:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787098338.454035:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787098338.454044:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1873908077789952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098338.454049:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787098338.454061:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077790080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098338.454083:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1873908077789952:12345-0@lo:400:kworker.0 Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098338.454103:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787098338.454122:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098338.454124:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077790080:12345-0@lo:400:kworker.0 Request processed in 65us (1707us total) trans 0 rc 0/0 00000100:00080000:2.0:1787098338.454127:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787098338.454135:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787098338.454165:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077789952:0@lo:400:kworker.0 00000100:00100000:2.0:1787098338.454175:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077789696:0@lo:400:kworker.0 00000100:00100000:1.0:1787098338.454207:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098338.454217:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098338.454238:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077790208:0@lo:400:kworker.0 00000100:00100000:0.0:1787098338.454257:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077789696 00000100:00100000:0.0:1787098338.454263:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077789696 00000100:00100000:1.0:1787098338.454273:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098338.454322:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787098338.454326:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077789568 00000100:00100000:1.0:1787098338.454332:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077789568 00000100:00100000:0.0:1787098338.454332:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3309:x1873908077789696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098338.454369:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787098338.454378:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1873908077789568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098338.454397:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098338.454442:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1873908077789568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098338.454450:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787098338.454476:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077790208 00000100:00100000:1.0:1787098338.454480:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077790208 00000100:00100000:2.0:1787098338.455195:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077790080:0@lo:400:kworker.0 00000100:00100000:1.0:1787098338.455211:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787098338.455224:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077790208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098338.455259:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787098338.455270:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077790336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098338.455334:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077790208:12345-0@lo:400:kworker.0 Request processed in 114us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098338.455351:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1873908077790336:12345-0@lo:400:kworker.0 Request processed in 83us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098338.455367:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3309:x1873908077789696:12345-0@lo:400:kworker.0 Request processed in 1036us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098338.455375:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787098338.457129:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077789824:0@lo:400:kworker.0 00000100:00100000:3.0:1787098338.457149:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1873908077790336:0@lo:400:kworker.0 00000100:00100000:3.0:1787098338.457224:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077789696:0@lo:400:kworker.0 00000100:00100000:1.0:1787098338.457273:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787098338.457314:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098338.457354:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077790208:0@lo:400:kworker.0 00000100:00100000:1.0:1787098338.457382:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077789568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098338.458043:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000001:00100000:0.0:1787098338.524382:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787098338.524404:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c 00000001:00080000:0.0:1787098338.524412:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1787098339.087841:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787098339.416603:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098339.416697:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059973760 00000100:00100000:3.0:1787098339.416707:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059973760 00000100:00100000:3.0:1787098339.416791:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1787098339.416803:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:13892:x1873908059973760:12345-192.168.204.51@tcp:41:lfs.0 00000004:00000024:3.0:1787098339.416846:0:14485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787098339.416940:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:13892:x1873908059973760:12345-192.168.204.51@tcp:41:lfs.0 Request processed in 140us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098339.416949:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00080000:1.0:1787098339.417560:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098339.422902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098339.423264:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059973888 00000100:00100000:1.0:1787098339.423277:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059973888 00000100:00100000:1.0:1787098339.423397:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1787098339.423408:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:13892:x1873908059973888:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:1.0:1787098339.423448:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098339.423543:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:13892:x1873908059973888:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 137us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098339.423551:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00080000:2.0:1787098339.423630:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787098339.426385:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098339.426484:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059974016 00000100:00100000:1.0:1787098339.426494:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059974016 00000100:00100000:1.0:1787098339.426611:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1787098339.426621:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:13892:x1873908059974016:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:1.0:1787098339.426661:0:15171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098339.426745:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:13892:x1873908059974016:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 126us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098339.426752:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00080000:2.0:1787098339.427797:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787098339.601082:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098339.601954:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059974144 00000100:00100000:2.0:1787098339.601973:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059974144 00000100:00100000:2.0:1787098339.602046:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:2.0:1787098339.602056:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+10:13923:x1873908059974144:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787098339.602083:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098339.602103:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7104b37600/0xb1d871f9b0145a74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e528789a expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098339.602148:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7104b37600/0xb1d871f9b0145a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528789a expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098339.602161:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7104b37600/0xb1d871f9b0145a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528789a expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098339.603385:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b37600, rc 0) 00000100:00100000:2.0:1787098339.603490:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+11:13923:x1873908059974144:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 1431us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098339.603500:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:3.0:1787098339.617878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098339.621507:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059974272 00000100:00100000:0.0:1787098339.621523:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059974272 00000100:00100000:0.0:1787098339.621678:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:0.0:1787098339.621689:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+11:13923:x1873908059974272:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787098339.622025:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+11:13923:x1873908059974272:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 337us (4155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098339.622033:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:3.0:1787098339.625569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098339.625685:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059974400 00000100:00100000:2.0:1787098339.625695:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059974400 00000100:00100000:2.0:1787098339.625753:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:2.0:1787098339.625763:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+11:13923:x1873908059974400:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787098339.626149:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+11:13923:x1873908059974400:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 386us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098339.626158:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:3.0:1787098339.637445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098339.637976:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059974528 00000100:00100000:0.0:1787098339.637988:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059974528 00000100:00100000:0.0:1787098339.638051:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:0.0:1787098339.638061:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+11:13931:x1873908059974528:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098339.638505:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+11:13931:x1873908059974528:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 444us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098339.638513:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:3.0:1787098339.672543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098339.672658:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059974656 00000100:00100000:2.0:1787098339.672668:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059974656 00000100:00100000:2.0:1787098339.672732:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:2.0:1787098339.672742:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+11:13931:x1873908059974656:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787098339.673041:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+11:13931:x1873908059974656:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 299us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098339.673048:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:3.0:1787098339.681603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098339.683095:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059974784 00000100:00100000:2.0:1787098339.683125:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059974784 00000100:00100000:2.0:1787098339.683258:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:2.0:1787098339.683270:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+11:13923:x1873908059974784:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787098339.683314:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098339.683332:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7104b37000/0xb1d871f9b0145a7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e52878c4 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098339.683361:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7104b37000/0xb1d871f9b0145a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878c4 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098339.683372:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7104b37000/0xb1d871f9b0145a7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878c4 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098339.683382:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b37000, rc 0) 00000100:00100000:2.0:1787098339.683443:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+12:13923:x1873908059974784:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 176us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098339.683451:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:3.0:1787098339.688451:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098339.688712:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059974912 00000100:00100000:0.0:1787098339.688723:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059974912 00000100:00100000:0.0:1787098339.688782:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:0.0:1787098339.688791:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+12:13923:x1873908059974912:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787098339.688817:0:14475:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787098339.688848:0:14475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787098339.688853:0:14475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787098339.688856:0:14475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787098339.688859:0:14475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787098339.694166:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+12:13923:x1873908059974912:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 5363us (5712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098339.694994:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:3.0:1787098339.696820:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098339.698512:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059975040 00000100:00100000:2.0:1787098339.698530:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059975040 00000100:00100000:2.0:1787098339.698607:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:2.0:1787098339.698618:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+12:13923:x1873908059975040:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787098339.698635:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098339.698657:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e52878cb expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098339.698693:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878cb expref: 13 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098339.698706:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878cb expref: 13 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098339.698735:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b36c00, rc 0) 00000100:00100000:2.0:1787098339.700707:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+13:13923:x1873908059975040:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 2080us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098339.700719:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:3.0:1787098339.704077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098339.704268:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059975168 00000100:00100000:0.0:1787098339.704292:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059975168 00000100:00100000:0.0:1787098339.704353:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:0.0:1787098339.704363:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:13923:x1873908059975168:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787098339.704681:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:13923:x1873908059975168:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 319us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098339.704691:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:3.0:1787098339.706891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098339.707123:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059975296 00000100:00100000:2.0:1787098339.707135:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059975296 00000100:00100000:2.0:1787098339.707211:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:2.0:1787098339.707223:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+13:13923:x1873908059975296:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787098339.707505:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+13:13923:x1873908059975296:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 283us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098339.707515:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:3.0:1787098339.711497:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098339.711646:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059975424 00000100:00100000:2.0:1787098339.711657:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059975424 00000100:00100000:2.0:1787098339.711718:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:2.0:1787098339.711728:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+13:13935:x1873908059975424:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787098339.711991:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+13:13935:x1873908059975424:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 264us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098339.712000:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:3.0:1787098339.715875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098339.720579:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059975552 00000100:00100000:0.0:1787098339.720598:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059975552 00000100:00100000:0.0:1787098339.720674:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:0.0:1787098339.720685:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:13935:x1873908059975552:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787098339.722061:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:13935:x1873908059975552:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 1371us (6190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098339.722083:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:2.0:1787098339.739035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098339.740136:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059975680 00000100:00100000:1.0:1787098339.740149:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059975680 00000100:00100000:1.0:1787098339.740911:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1787098339.740922:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2372:x1873908059975680:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787098339.741059:0:14484:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 41ff0bcc-bd57-401b-b53f-69920533991a@192.168.204.51@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1787098339.741116:0:14484:0:(genops.c:1406:class_connect()) connect: client 41ff0bcc-bd57-401b-b53f-69920533991a, cookie 0xb1d871f9b0145a89 00000004:00100000:1.0:1787098339.741151:0:14484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787098339.742672:0:14484:0:(import.c:65:import_set_state_nolock()) ffff8d7105e9f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098339.742769:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41ff0bcc-bd57-401b-b53f-69920533991a+6:2372:x1873908059975680:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 1845us (3815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098339.742781:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1787098339.747615:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098339.747717:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098339.748036:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059975936 00000100:00100000:3.0:1787098339.748047:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059975936 00000100:00080000:2.0:1787098339.748212:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787098339.748444:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059975808 00000100:00100000:3.0:1787098339.748449:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059975808 00000100:00100000:1.0:1787098339.748671:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1787098339.748684:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41ff0bcc-bd57-401b-b53f-69920533991a+7:13923:x1873908059975936:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787098339.748730:0:15191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787098339.748894:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1787098339.748905:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41ff0bcc-bd57-401b-b53f-69920533991a+7:0:x1873908059975808:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787098339.748921:0:14483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787098339.749101:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41ff0bcc-bd57-401b-b53f-69920533991a+7:0:x1873908059975808:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 199us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098339.749109:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1787098339.749161:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41ff0bcc-bd57-401b-b53f-69920533991a+6:13923:x1873908059975936:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 480us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098339.749169:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1787098339.751370:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098339.751544:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059976064 00000100:00100000:0.0:1787098339.751553:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059976064 00000100:00100000:0.0:1787098339.751604:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1787098339.751614:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41ff0bcc-bd57-401b-b53f-69920533991a+6:13923:x1873908059976064:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787098339.751699:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41ff0bcc-bd57-401b-b53f-69920533991a+6:13923:x1873908059976064:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 85us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098339.751707:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1787098339.754591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098339.756004:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059976192 00000100:00100000:3.0:1787098339.756015:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059976192 00000100:00100000:3.0:1787098339.756074:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1787098339.756082:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1873908059976192:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787098339.756114:0:15167:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 41ff0bcc-bd57-401b-b53f-69920533991a@192.168.204.51@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1787098339.756140:0:15167:0:(genops.c:1406:class_connect()) connect: client 41ff0bcc-bd57-401b-b53f-69920533991a, cookie 0xb1d871f9b0145a90 00002000:00100000:3.0:1787098339.756156:0:15167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 41ff0bcc-bd57-401b-b53f-69920533991a/ffff8d723fe73000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787098339.756166:0:15167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787098339.756652:0:15167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787098339.756691:0:15167:0:(import.c:65:import_set_state_nolock()) ffff8d723fe74000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787098339.756771:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41ff0bcc-bd57-401b-b53f-69920533991a+6:2372:x1873908059976192:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 688us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098339.756779:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1787098339.756989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098339.757016:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059976320 00000100:00100000:1.0:1787098339.757021:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059976320 00000100:00100000:1.0:1787098339.757045:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1787098339.757050:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7106022d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2372:x1873908059976320:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787098339.757080:0:15170:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 41ff0bcc-bd57-401b-b53f-69920533991a@192.168.204.51@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1787098339.757105:0:15170:0:(genops.c:1406:class_connect()) connect: client 41ff0bcc-bd57-401b-b53f-69920533991a, cookie 0xb1d871f9b0145a97 00002000:00100000:1.0:1787098339.757112:0:15170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 41ff0bcc-bd57-401b-b53f-69920533991a/ffff8d7105e9f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113901 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787098339.757121:0:15170:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787098339.757347:0:15170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787098339.757365:0:15170:0:(import.c:65:import_set_state_nolock()) ffff8d7105e9a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787098339.757404:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7106022d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41ff0bcc-bd57-401b-b53f-69920533991a+6:2372:x1873908059976320:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 352us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098339.757412:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1787098339.758520:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098339.758638:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059976448 00000100:00100000:0.0:1787098339.758646:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059976448 00000100:00100000:0.0:1787098339.758685:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1787098339.758694:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41ff0bcc-bd57-401b-b53f-69920533991a+6:13923:x1873908059976448:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787098339.758933:0:14487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787098339.759088:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41ff0bcc-bd57-401b-b53f-69920533991a+6:13923:x1873908059976448:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 394us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098339.759096:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1787098339.917536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098339.917630:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059976576 00000100:00100000:3.0:1787098339.917641:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059976576 00000100:00100000:3.0:1787098339.917713:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1787098339.917725:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+6:13956:x1873908059976576:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:3.0:1787098339.917748:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098339.917773:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7400/0xb1d871f9b0145a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52878f5 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098339.917846:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098339.917880:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098339.917897:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098339.918119:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787098339.918124:0:14485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098339.918333:0:14485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098339.918365:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7400/0xb1d871f9b0145a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878f5 expref: 8 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098339.918387:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878f5 expref: 7 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098339.918396:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d72038cde00) 00010000:00010000:3.0:1787098339.918399:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098339.918403:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6800, rc 0) 00000100:00100000:3.0:1787098339.918533:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+7:13956:x1873908059976576:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 810us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098339.918542:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00010000:00010000:0.0:1787098340.111494:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787098341.073748:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c 00000001:00100000:2.0:1787098341.073773:0:6727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41ff0bcc-bd57-401b-b53f-69920533991a 00010000:00010000:2.0:1787098341.138322:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787098342.159597:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787098342.389392:0:16446:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787098342.546095:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077790464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787098342.546171:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098342.546299:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077790464 00000100:00100000:3.0:1787098342.546307:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077790464 00000100:00100000:3.0:1787098342.546362:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787098342.546387:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077790464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787098342.546423:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098342.546468:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077790464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098342.546476:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787098342.546498:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787098342.546790:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077790464:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787098342.600143:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41ff0bcc-bd57-401b-b53f-69920533991a 00000001:00100000:3.0:1787098342.600159:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85a9a2aa-4d4f-47f9-beda-b138dd8bb05c 00010000:00010000:0.0:1787098343.183599:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098343.567590:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077790592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098343.567660:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098343.567791:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077790592 00000100:00100000:1.0:1787098343.567814:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077790592 00000100:00100000:1.0:1787098343.567883:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787098343.567893:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077790592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787098343.567927:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787098343.567976:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077790592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098343.567984:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787098343.568036:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787098343.568060:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077790592:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787098343.568113:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787098343.570228:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077791104:0@lo:400:kworker.0 00000100:00100000:1.0:1787098343.570322:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098343.570357:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787098343.570364:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077790976:0@lo:400:kworker.0 00000100:00100000:1.0:1787098343.570387:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098343.570419:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077791104 00000100:00100000:1.0:1787098343.570426:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077791104 00000100:00100000:1.0:1787098343.570473:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077790976 00000100:00100000:1.0:1787098343.570477:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077790976 00000100:00100000:1.0:1787098343.570496:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787098343.570504:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077791104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098343.570548:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1873908077791104:12345-0@lo:400:kworker.0 Request processed in 45us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098343.570555:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787098343.570570:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787098343.570576:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077790976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098343.570596:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1873908077790976:12345-0@lo:400:kworker.0 Request processed in 20us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098343.570611:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787098343.570638:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098343.570666:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1873908077790976:0@lo:400:kworker.0 00000100:00100000:1.0:1787098343.570676:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1873908077791104:0@lo:400:kworker.0 00000100:00100000:2.0:1787098343.570774:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc79daaf-8bf3-4a07-a406-566e9526a151:3311:1873908077790720:0@lo:400:kworker.0 00000100:00100000:2.0:1787098343.570809:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098343.570834:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077791232:0@lo:400:kworker.0 00000100:00100000:2.0:1787098343.570853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098343.570865:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787098343.570871:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077790848:0@lo:400:kworker.0 00000100:00100000:2.0:1787098343.570893:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098343.571005:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077790848 00000100:00100000:0.0:1787098343.571010:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077790848 00000100:00100000:0.0:1787098343.571050:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787098343.571057:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077790848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098343.571096:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077790848:12345-0@lo:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098343.571111:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098343.571198:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077790848:0@lo:400:kworker.0 00000100:00100000:1.0:1787098343.571976:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077790720 00000100:00100000:1.0:1787098343.571983:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077790720 00000100:00100000:1.0:1787098343.572041:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787098343.572048:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3311:x1873908077790720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098343.572116:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3311:x1873908077790720:12345-0@lo:400:kworker.0 Request processed in 69us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098343.572124:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787098343.572158:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077791232 00000100:00100000:1.0:1787098343.572161:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077791232 00000100:00100000:1.0:1787098343.572190:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787098343.572195:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077791232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098343.572221:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1873908077791232:12345-0@lo:400:kworker.0 Request processed in 26us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098343.572227:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787098343.572244:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098343.572367:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc79daaf-8bf3-4a07-a406-566e9526a151:3311:1873908077790720:0@lo:400:kworker.0 00000100:00100000:0.0:1787098343.572380:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1873908077791232:0@lo:400:kworker.0 00000001:00100000:0.0:1787098343.659044:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41ff0bcc-bd57-401b-b53f-69920533991a 00010000:00010000:0.0:1787098344.209018:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787098344.528595:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787098344.988505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098344.988543:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098344.988565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098344.988583:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098344.988600:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098344.988618:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098344.988650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098344.988672:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059976704 00000100:00100000:1.0:1787098344.988681:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059976704 00000100:00100000:1.0:1787098344.988727:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1787098344.988738:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:2376:x1873908059976704:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098344.988803:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:2376:x1873908059976704:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 68us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098344.988811:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1787098344.988842:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059977216 00000100:00100000:1.0:1787098344.988845:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059977216 00000100:00100000:1.0:1787098344.988871:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059976832 00000100:00100000:1.0:1787098344.988873:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059976832 00000100:00100000:1.0:1787098344.988889:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1787098344.988893:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+6:2376:x1873908059977216:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098344.988922:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+6:2376:x1873908059977216:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098344.988928:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1787098344.988938:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1787098344.988944:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:2376:x1873908059976832:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098344.988974:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:2376:x1873908059976832:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 20us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098344.988980:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1787098344.988999:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059976960 00000100:00100000:1.0:1787098344.989002:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059976960 00000100:00100000:1.0:1787098344.989020:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059977472 00000100:00100000:1.0:1787098344.989022:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059977472 00000100:00100000:1.0:1787098344.989032:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059977088 00000100:00100000:1.0:1787098344.989040:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059977088 00000100:00100000:1.0:1787098344.989052:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059977344 00000100:00100000:1.0:1787098344.989054:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059977344 00000100:00100000:1.0:1787098344.989067:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1787098344.989072:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2376:x1873908059976960:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098344.989099:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2376:x1873908059976960:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098344.989105:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1787098344.989115:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1787098344.989121:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41ff0bcc-bd57-401b-b53f-69920533991a+5:2376:x1873908059977472:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098344.989142:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41ff0bcc-bd57-401b-b53f-69920533991a+5:2376:x1873908059977472:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 20us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098344.989148:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1787098344.989158:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1787098344.989164:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2376:x1873908059977088:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098344.989189:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2376:x1873908059977088:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098344.989195:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1787098344.989216:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1787098344.989223:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41ff0bcc-bd57-401b-b53f-69920533991a+5:2376:x1873908059977344:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1787098344.989245:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41ff0bcc-bd57-401b-b53f-69920533991a+5:2376:x1873908059977344:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098344.989251:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00080000:1.0:1787098344.989938:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787098344.989948:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787098344.989951:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787098345.231978:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787098345.888668:0:16596:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8d108670 20000000:00000080:0.0:1787098345.888685:0:16596:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d710664e000 uarg=0000000000000000 20000000:01000000:0.0:1787098345.888719:0:16596:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787098345.888724:0:16596:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787098345.888729:0:16596:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787098345.892592:0:16597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787098345.892756:0:16596:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787098345.907416:0:16596:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787098345.908056:0:16596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908079:0:16596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014579c expref: 18 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908086:0:16596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b01457e9 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908093:0:16596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b014591d expref: 18 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908103:0:16596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287869 expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908110:0:16596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878cb expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908136:0:16596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908186:0:16596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878cb expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908200:0:16596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878cb expref: 12 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098345.908215:0:16596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba02680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791360:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098345.908383:0:16596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287869 expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908392:0:16596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287869 expref: 12 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098345.908401:0:16596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791488:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098345.908432:0:16596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b014591d expref: 18 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908440:0:16596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b014591d expref: 18 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098345.908450:0:16596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791616:0@lo:104: 00000100:00100000:0.0:1787098345.908487:0:16596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787098345.908522:0:16596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b01457e9 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908540:0:16596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b01457e9 expref: 18 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098345.908550:0:16596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791744:0@lo:104: 00000100:00100000:0.0:1787098345.908573:0:16596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787098345.908606:0:16596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb1d871f9b014579c expref: 18 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.908613:0:16596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb1d871f9b014579c expref: 18 pid: 14475 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098345.908622:0:16596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227485180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791872:0@lo:104: 00000100:00100000:0.0:1787098345.908645:0:16596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098345.908655:0:16596:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72049fe240 going to sleep for 11 seconds 00000100:00100000:3.0:1787098345.908728:0:14467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787098345.908743:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077791616 00000100:00100000:3.0:1787098345.908749:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077791616 00000100:00100000:3.0:1787098345.908788:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077791744 00000100:00100000:3.0:1787098345.908791:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077791744 00000100:00100000:3.0:1787098345.908801:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077791872 00000100:00100000:3.0:1787098345.908803:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077791872 00000100:00100000:3.0:1787098345.908816:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787098345.908825:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+5:16596:x1873908077791616:12345-0@lo:104: 00010000:00010000:3.0:1787098345.908838:0:14467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.908904:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787098345.908910:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+5:16596:x1873908077791616:12345-0@lo:104: Request processed in 86us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098345.908924:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787098345.908955:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787098345.908963:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+4:16596:x1873908077791744:12345-0@lo:104: 00010000:00010000:3.0:1787098345.908971:0:14467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909008:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787098345.909013:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+4:16596:x1873908077791744:12345-0@lo:104: Request processed in 52us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098345.909020:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787098345.909031:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787098345.909037:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723b973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+3:16596:x1873908077791872:12345-0@lo:104: 00010000:00010000:3.0:1787098345.909043:0:14467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909075:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787098345.909081:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723b973050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+3:16596:x1873908077791872:12345-0@lo:104: Request processed in 45us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098345.909086:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787098345.909122:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787098345.909128:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909136:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227623e00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098345.909139:0:14471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909159:0:14471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098345.909166:0:14471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098345.909172:0:14471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787098345.909198:0:14471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909204:0:14471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098345.909224:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909231:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227623e00/0xb1d871f9b014591d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b0145924 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909244:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787098345.909247:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909252:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413e00 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098345.909255:0:14471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909260:0:14471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098345.909265:0:14471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098345.909275:0:14471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787098345.909314:0:14471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909320:0:14471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098345.909335:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909340:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227413e00/0xb1d871f9b01457e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01457f0 expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909349:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787098345.909351:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909357:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413400 already unused, calling callback (ffffffffc1d1dc20) 10000000:00010000:3.0:1787098345.909359:0:14471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909366:0:14471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787098345.909372:0:14471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098345.909377:0:14471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787098345.909392:0:14471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909397:0:14471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787098345.909408:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909413:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff8d7227413400/0xb1d871f9b014579c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb1d871f9b01457a3 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909425:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098345.909427:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098345.909428:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098345.909434:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098345.909439:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098345.909449:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077792000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098345.909478:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098345.909525:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077792128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098345.909545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098345.909563:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787098345.909568:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077792256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098345.909587:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098345.909611:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077792000 00000100:00100000:3.0:1787098345.909614:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077792000 00000100:00100000:2.0:1787098345.909625:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077792128 00000100:00100000:2.0:1787098345.909629:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077792128 00010000:00010000:3.0:1787098345.909632:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014591d expref: 20 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.909643:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01457e9 expref: 20 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098345.909645:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077792256 00000100:00100000:3.0:1787098345.909647:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077792256 00010000:00010000:3.0:1787098345.909656:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014579c expref: 21 pid: 14475 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098345.909656:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098345.909661:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+21:3312:x1873908077792000:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098345.909666:0:14470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787098345.909671:0:14470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787098345.909672:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098345.909677:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014591d expref: 21 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.909685:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b014591d expref: 21 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098345.909689:0:14468:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787098345.909697:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787098345.909700:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787098345.909703:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+21:3309:x1873908077792128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787098345.909709:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098345.909714:0:14468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b01457e9 expref: 21 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909723:0:14468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b01457e9 expref: 21 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098345.909732:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098345.909733:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+21:3312:x1873908077792000:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098345.909739:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787098345.909752:0:14469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787098345.909755:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dc79daaf-8bf3-4a07-a406-566e9526a151+20:3309:x1873908077792128:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098345.909758:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787098345.909761:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787098345.909763:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72087cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+20:3309:x1873908077792256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098345.909769:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098345.909773:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb1d871f9b014579c expref: 19 pid: 14475 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.909781:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb1d871f9b014579c expref: 19 pid: 14475 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098345.909788:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077792128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787098345.909789:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787098345.909904:0:16596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227413c00/0xb1d871f9b0145924 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b014591d expref: 19 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098345.909914:0:16596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba01f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791616:0@lo:104: 00010000:00010000:0.0:1787098345.909923:0:16596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7200030c00/0xb1d871f9b01457f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b01457e9 expref: 18 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098345.909933:0:16596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7106023480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791744:0@lo:104: 00010000:00010000:0.0:1787098345.909942:0:16596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7227623600/0xb1d871f9b01457a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb1d871f9b014579c expref: 17 pid: 14475 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098345.909961:0:16596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227485180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791872:0@lo:104: 00000100:00100000:2.0:1787098345.910918:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72087cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc79daaf-8bf3-4a07-a406-566e9526a151+16:3309:x1873908077792256:12345-0@lo:103:ldlm_bl.0 Request processed in 1150us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098345.910928:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787098345.911364:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dc79daaf-8bf3-4a07-a406-566e9526a151:3312:1873908077792000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787098345.911735:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dc79daaf-8bf3-4a07-a406-566e9526a151:3309:1873908077792256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787098345.920664:0:16596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba02680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791360:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098345.920722:0:16596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16596:1873908077791488:192.168.204.51@tcp:104: 00010000:00010000:0.0:1787098345.920766:0:16596:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098345.921115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098345.921227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098345.921515:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059977728 00000100:00100000:3.0:1787098345.921523:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059977728 00010000:00010000:3.0:1787098345.921561:0:14468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287869 expref: 13 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098345.921626:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059977600 00000100:00100000:3.0:1787098345.921630:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059977600 00010000:00010000:3.0:1787098345.921644:0:14468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878cb expref: 14 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098345.921677:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1787098345.921691:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9710efb3-276e-45a2-a075-9c71c786ced4+14:2374:x1873908059977728:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098345.921704:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098345.921710:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287869 expref: 14 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921720:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287869 expref: 14 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921738:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7104b37200/0xb1d871f9b0145a4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287869 expref: 14 pid: 14478 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921762:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098345.921822:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9710efb3-276e-45a2-a075-9c71c786ced4+13:2374:x1873908059977728:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 134us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098345.921830:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1787098345.921850:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1787098345.921856:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9710efb3-276e-45a2-a075-9c71c786ced4+12:2374:x1873908059977600:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098345.921863:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098345.921867:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878cb expref: 12 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921877:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878cb expref: 12 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921886:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145a82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878cb expref: 12 pid: 14477 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921896:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921904:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921917:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921923:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921939:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921958:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921965:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204ea00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:2.0:1787098345.921969:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921978:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.921992:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098345.922001:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098345.922022:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9710efb3-276e-45a2-a075-9c71c786ced4+11:2374:x1873908059977600:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 166us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098345.922028:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00010000:00010000:0.0:1787098345.922184:0:16596:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.922193:0:16596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098345.922199:0:16596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d724204ea00/0xb1d871f9b0145aac lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098346.255674:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787098347.279495:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787098347.407954:0:14480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787098347.407976:0:14480:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7204a5a800 from 10 10000000:01000000:3.0:1787098347.407981:0:14480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787098347.408028:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7800/0xb1d871f9b0145ab3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.408039:0:14480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d72421c7800/0xb1d871f9b0145ab3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.408050:0:14480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d72421c7800/0xb1d871f9b0145ab3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098347.408079:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.408161:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098347.408270:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7202ed1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787098347.409576:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077792384 00000100:00100000:1.0:1787098347.409587:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077792384 00000100:00100000:1.0:1787098347.409645:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787098347.409655:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+16:14480:x1873908077792384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098347.409672:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098347.409690:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0145aba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0145ab3 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098347.409718:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0145aba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0145ab3 expref: 17 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098347.409729:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227413e00/0xb1d871f9b0145aba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145ab3 expref: 17 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098347.409739:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413e00, rc 0) 00000100:00100000:1.0:1787098347.409798:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:14480:x1873908077792384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098347.409805:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787098347.410979:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098347.411003:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d72421c7800/0xb1d871f9b0145ab3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145aba expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.411016:0:14480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d72421c7800/0xb1d871f9b0145ab3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145aba expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098347.411090:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.411207:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098347.411246:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72049fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098347.411266:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077792512 00000100:00100000:3.0:1787098347.411271:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077792512 00000100:00100000:3.0:1787098347.411343:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787098347.411351:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+17:14480:x1873908077792512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.411607:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+17:14480:x1873908077792512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098347.411622:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787098347.411665:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.411694:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.411731:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098347.411752:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72049fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787098347.411764:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077792640 00000100:00100000:3.0:1787098347.411767:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077792640 00000100:00100000:3.0:1787098347.411789:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787098347.411795:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+17:14480:x1873908077792640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.411947:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+17:14480:x1873908077792640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098347.411954:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787098347.411993:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787098347.412645:0:16671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787098347.413268:0:14480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787098347.413309:0:14480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787098347.413320:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c7800/0xb1d871f9b0145ab3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145aba expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098347.413331:0:14480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d72421c7800/0xb1d871f9b0145ab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145aba expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787098347.413357:0:14480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787098347.413359:0:14480:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d7203e35800 from 10 10000000:01000000:1.0:1787098347.413362:0:14480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787098347.413394:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0145ac1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098347.413402:0:14480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0145ac1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098347.413412:0:14480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0145ac1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098347.413434:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787098347.413486:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098347.413520:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d710491a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787098347.413790:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077792768 00000100:00100000:3.0:1787098347.413796:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077792768 00000100:00100000:3.0:1787098347.413834:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787098347.413844:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+17:14480:x1873908077792768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098347.413856:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098347.413870:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d72421c7400/0xb1d871f9b0145ac8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0145ac1 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.413893:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d72421c7400/0xb1d871f9b0145ac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0145ac1 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.413927:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d72421c7400/0xb1d871f9b0145ac8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145ac1 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.413936:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7400, rc 0) 00000100:00100000:3.0:1787098347.413994:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc79daaf-8bf3-4a07-a406-566e9526a151+18:14480:x1873908077792768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098347.414001:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787098347.414041:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787098347.414054:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0145ac1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145ac8 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.414062:0:14480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0145ac1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145ac8 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098347.414233:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.414263:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098347.414379:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72049fe240 going to sleep for 11 seconds 00000100:00100000:3.0:1787098347.414396:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077792896 00000100:00100000:3.0:1787098347.414400:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077792896 00000100:00100000:3.0:1787098347.414424:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787098347.414431:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:14480:x1873908077792896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.414661:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:14480:x1873908077792896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098347.414668:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787098347.414698:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077792896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.414732:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077793024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.414764:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098347.414776:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72049fe240 going to sleep for 11 seconds 00000100:00100000:3.0:1787098347.414786:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077793024 00000100:00100000:3.0:1787098347.414789:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077793024 00000100:00100000:3.0:1787098347.414807:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787098347.414812:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:14480:x1873908077793024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.415084:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:14480:x1873908077793024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 271us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098347.415207:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787098347.415251:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077793024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787098347.417613:0:16672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787098347.418225:0:14480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787098347.418250:0:14480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787098347.418261:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0145ac1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145ac8 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.418274:0:14480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d7227413c00/0xb1d871f9b0145ac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145ac8 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787098347.418321:0:14480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787098347.418324:0:14480:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8d72417b6800 from 10 10000000:01000000:3.0:1787098347.418327:0:14480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787098347.418364:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c6400/0xb1d871f9b0145acf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.418372:0:14480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff8d72421c6400/0xb1d871f9b0145acf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098347.418398:0:14480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff8d72421c6400/0xb1d871f9b0145acf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098347.418422:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077793152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787098347.418487:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098347.418532:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72049fe240 going to sleep for 11 seconds 00000100:00100000:0.0:1787098347.418942:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077793152 00000100:00100000:0.0:1787098347.419158:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077793152 00000100:00100000:0.0:1787098347.419222:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787098347.419233:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+18:14480:x1873908077793152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787098347.419248:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098347.419263:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0145ad6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1d871f9b0145acf expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098347.419312:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0145ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb1d871f9b0145acf expref: 19 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098347.419323:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d724204ee00/0xb1d871f9b0145ad6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb1d871f9b0145acf expref: 19 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098347.419332:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204ee00, rc 0) 00000100:00100000:0.0:1787098347.419394:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:14480:x1873908077793152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098347.419411:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787098347.419520:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a89c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077793152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098347.419536:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff8d72421c6400/0xb1d871f9b0145acf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145ad6 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098347.419545:0:14480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff8d72421c6400/0xb1d871f9b0145acf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb1d871f9b0145ad6 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098347.419599:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077793280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787098347.419720:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098347.419752:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787098347.419771:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077793280 00000100:00100000:1.0:1787098347.419777:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077793280 00000100:00100000:1.0:1787098347.419824:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787098347.419831:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+19:14480:x1873908077793280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787098347.420092:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc79daaf-8bf3-4a07-a406-566e9526a151+19:14480:x1873908077793280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098347.420100:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787098347.420134:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077793280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098347.420170:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227485180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077793408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787098347.420212:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098347.420235:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72068283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787098347.420262:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077793408 00000100:00100000:1.0:1787098347.420266:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077793408 00000100:00100000:1.0:1787098347.420305:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787098347.420312:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:14480:x1873908077793408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098347.420562:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:14480:x1873908077793408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098347.420576:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787098347.420611:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227485180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dc79daaf-8bf3-4a07-a406-566e9526a151:14480:1873908077793408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787098347.428463:0:16673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787098347.429455:0:14480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787098347.429486:0:14480:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787098347.429498:0:14480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff8d72421c6400/0xb1d871f9b0145acf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145ad6 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098347.429510:0:14480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff8d72421c6400/0xb1d871f9b0145acf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb1d871f9b0145ad6 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098347.477146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098347.477907:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059977856 00000100:00100000:2.0:1787098347.477928:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059977856 00000100:00100000:2.0:1787098347.478019:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:2.0:1787098347.478030:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+11:13808:x1873908059977856:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787098347.478046:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098347.478064:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145add lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e52878fc expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098347.478091:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145add lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878fc expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098347.478103:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7104b36c00/0xb1d871f9b0145add lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878fc expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098347.478111:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b36c00, rc 0) 00000100:00100000:2.0:1787098347.478174:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+12:13808:x1873908059977856:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 145us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098347.478180:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:1.0:1787098347.480667:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098347.480736:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059977984 00000100:00100000:0.0:1787098347.480746:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059977984 00000100:00100000:0.0:1787098347.480799:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:0.0:1787098347.480809:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723d4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+12:13808:x1873908059977984:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098347.481137:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723d4e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+12:13808:x1873908059977984:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 328us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098347.481145:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:1.0:1787098347.483101:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098347.483182:0:14478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059978112 00000100:00100000:2.0:1787098347.483190:0:14478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059978112 00000100:00100000:2.0:1787098347.483240:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1787098347.483250:0:14478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+12:13808:x1873908059978112:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787098347.483496:0:14478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f21a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9710efb3-276e-45a2-a075-9c71c786ced4+12:13808:x1873908059978112:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 246us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098347.483505:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:3.0:1787098347.493225:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098347.493988:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059978240 00000100:00100000:1.0:1787098347.493999:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059978240 00000100:00100000:1.0:1787098347.494071:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:1.0:1787098347.494081:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+12:13808:x1873908059978240:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787098347.494099:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098347.494119:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7227413a00/0xb1d871f9b0145ae4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287903 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098347.494146:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7227413a00/0xb1d871f9b0145ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287903 expref: 13 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098347.494158:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7227413a00/0xb1d871f9b0145ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287903 expref: 13 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098347.494167:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413a00, rc 0) 00000100:00100000:1.0:1787098347.494231:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f219850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:13808:x1873908059978240:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 152us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098347.494239:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:3.0:1787098347.498511:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098347.498620:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059978368 00000100:00100000:0.0:1787098347.498631:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059978368 00000100:00100000:0.0:1787098347.498692:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:0.0:1787098347.498701:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+13:13808:x1873908059978368:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787098347.499678:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f218c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9710efb3-276e-45a2-a075-9c71c786ced4+13:13808:x1873908059978368:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 973us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098347.499688:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:2.0:1787098347.505400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098347.506413:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059978496 00000100:00100000:1.0:1787098347.506423:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059978496 00000100:00100000:1.0:1787098347.506486:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:1.0:1787098347.506496:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:13808:x1873908059978496:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787098347.506729:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f219450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:13808:x1873908059978496:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 232us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098347.506746:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:1.0:1787098347.664481:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077793536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787098347.664559:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098347.664668:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077793536 00000100:00100000:3.0:1787098347.664676:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077793536 00000100:00100000:3.0:1787098347.664739:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787098347.664749:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077793536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787098347.664799:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098347.664851:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1873908077793536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098347.664858:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787098347.664919:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1873908077793536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787098347.665086:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787098348.306855:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098348.687968:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077793664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787098348.688057:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098348.688323:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077793664 00000100:00100000:3.0:1787098348.688331:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077793664 00000100:00100000:3.0:1787098348.688411:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787098348.688418:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077793920:0@lo:400:kworker.0 00000100:00100000:3.0:1787098348.688425:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077793664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787098348.688463:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787098348.688466:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787098348.688495:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787098348.688503:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc79daaf-8bf3-4a07-a406-566e9526a151:3310:1873908077793792:0@lo:400:kworker.0 00000100:00100000:3.0:1787098348.688526:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077793664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098348.688537:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098348.688549:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787098348.688557:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077794304:0@lo:400:kworker.0 00000100:00100000:2.0:1787098348.688580:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098348.688611:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077793920 00000100:00100000:3.0:1787098348.688612:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077794048:0@lo:400:kworker.0 00000100:00100000:2.0:1787098348.688615:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077793920 00000100:00100000:2.0:1787098348.688649:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787098348.688654:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098348.688659:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077793920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098348.688686:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787098348.688694:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7241a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077794176:0@lo:400:kworker.0 00000100:00100000:2.0:1787098348.688700:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1873908077793920:12345-0@lo:400:kworker.0 Request processed in 41us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098348.688708:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787098348.688726:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077794304 00000100:00100000:3.0:1787098348.688727:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098348.688730:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077794304 00000100:00100000:2.0:1787098348.688759:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077794048 00000100:00100000:2.0:1787098348.688761:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077794048 00000100:00100000:3.0:1787098348.688768:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077794176 00000100:00100000:3.0:1787098348.688774:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077794176 00000100:00100000:2.0:1787098348.688778:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787098348.688787:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077794304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098348.688807:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787098348.688819:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1873908077794304:12345-0@lo:400:kworker.0 Request processed in 32us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098348.688820:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077794048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098348.688831:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787098348.688845:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787098348.688852:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077794176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098348.688872:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077794048:12345-0@lo:400:kworker.0 Request processed in 56us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098348.688880:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787098348.688885:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077794176:12345-0@lo:400:kworker.0 Request processed in 32us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098348.688908:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787098348.688938:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077794176:0@lo:400:kworker.0 00000100:00100000:2.0:1787098348.688949:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1873908077794304:0@lo:400:kworker.0 00000100:00100000:3.0:1787098348.688956:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7241a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077794048:0@lo:400:kworker.0 00000100:00100000:2.0:1787098348.688965:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1873908077793920:0@lo:400:kworker.0 00000100:00100000:3.0:1787098348.689010:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077793664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787098348.689992:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077793792 00000100:00100000:0.0:1787098348.690000:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077793792 00000100:00100000:0.0:1787098348.690046:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787098348.690053:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3310:x1873908077793792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787098348.690141:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f219c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3310:x1873908077793792:12345-0@lo:400:kworker.0 Request processed in 88us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098348.690148:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1787098348.690334:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787098348.690339:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787098348.690408:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dc79daaf-8bf3-4a07-a406-566e9526a151:3310:1873908077793792:0@lo:400:kworker.0 00000100:00100000:0.0:1787098348.794379:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098348.794547:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059978624 00000100:00100000:3.0:1787098348.794558:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059978624 00000100:00100000:3.0:1787098348.794974:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1787098348.794985:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:14467:x1873908059978624:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787098348.795019:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098348.795041:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528790a expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795125:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795139:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795153:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795167:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795174:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795179:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795682:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145b00 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795693:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145b00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795712:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145b00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098348.795797:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787098348.795801:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098348.795913:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145b00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795939:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795946:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795954:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795960:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098348.795965:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795972:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.795986:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d72038cde00) 00010000:00010000:3.0:1787098348.795989:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098348.795994:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796000:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145af2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796014:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796020:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796026:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796038:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098348.796042:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796048:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796056:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d7207e92800) 00010000:00010000:3.0:1787098348.796059:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098348.796062:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796068:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145af9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796106:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528790a expref: 8 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796122:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7000/0xb1d871f9b0145b00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528790a expref: 7 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.796130:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:3.0:1787098348.796132:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098348.796134:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7000, rc 0) 00000100:00100000:3.0:1787098348.796215:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:14467:x1873908059978624:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1230us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098348.796224:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1787098348.800851:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098348.800982:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059978880 00000100:00100000:3.0:1787098348.801018:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059978880 00000100:00080000:1.0:1787098348.802256:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098348.805520:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1787098348.805549:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:14467:x1873908059978880:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098348.806075:0:15191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098348.806106:0:15191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145b07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287911 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.806185:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.806201:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.806213:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.806228:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.806235:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.806242:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.808262:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36800/0xb1d871f9b0145b1c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.808781:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36800/0xb1d871f9b0145b1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.808795:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36800/0xb1d871f9b0145b1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098348.808809:0:15191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787098348.811840:0:15191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.811860:0:15191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.811880:0:15191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.811897:0:15191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b37a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098348.811903:0:15191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.811911:0:15191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.811932:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d7207e92b00) 00010000:00010000:2.0:1787098348.811935:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098348.811940:0:15191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.811968:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145b0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.811986:0:15191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.812002:0:15191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.812009:0:15191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.812014:0:15191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b36200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098348.812017:0:15191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.812023:0:15191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.812032:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d72085a6b00) 00010000:00010000:2.0:1787098348.812035:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098348.812037:0:15191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.812043:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145b15 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.812583:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145b07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287911 expref: 10 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.812611:0:15191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36800/0xb1d871f9b0145b1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287911 expref: 9 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.812618:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d72085a6a00) 00010000:00010000:2.0:1787098348.812620:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098348.812622:0:15191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b36800, rc 0) 00000100:00100000:2.0:1787098348.812693:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:14467:x1873908059978880:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 7158us (11853us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787098348.812703:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1787098348.824457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098348.824788:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059979008 00000100:00100000:3.0:1787098348.824799:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059979008 00000100:00100000:3.0:1787098348.824864:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1787098348.824875:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:14467:x1873908059979008:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787098348.825521:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:14467:x1873908059979008:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 644us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098348.825531:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1787098348.862100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098348.862430:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059979136 00000100:00100000:3.0:1787098348.862442:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059979136 00000100:00100000:3.0:1787098348.862515:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1787098348.862526:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:14473:x1873908059979136:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098348.862551:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098348.862576:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287918 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.862841:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.862859:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.862872:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.862898:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.862905:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.862930:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864067:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864082:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864089:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864096:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098348.864100:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864108:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864266:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d72038cde00) 00010000:00010000:3.0:1787098348.864270:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098348.864492:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864499:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864517:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864524:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864541:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864547:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098348.864550:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864556:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864565:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d7207e92800) 00010000:00010000:3.0:1787098348.864567:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098348.864570:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864576:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864745:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287918 expref: 10 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864756:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d72038cde00) 00010000:00010000:3.0:1787098348.864759:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098348.864762:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287918 expref: 10 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.864772:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6600, rc 0) 00000100:00100000:3.0:1787098348.864918:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:14473:x1873908059979136:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 2392us (2826us total) trans 0 rc 301/301 00000100:00100000:3.0:1787098348.864935:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1787098348.869884:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098348.869975:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059979264 00000100:00100000:3.0:1787098348.869985:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059979264 00000100:00100000:3.0:1787098348.870192:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1787098348.870203:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:14473:x1873908059979264:12345-192.168.204.51@tcp:700:lfs.0 00000100:00100000:3.0:1787098348.870394:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:14473:x1873908059979264:12345-192.168.204.51@tcp:700:lfs.0 Request processed in 192us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098348.870404:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1787098348.878225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098348.879254:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059979520 00000100:00100000:0.0:1787098348.879267:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059979520 00000100:00100000:0.0:1787098348.879424:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1787098348.879435:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:14473:x1873908059979520:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:0.0:1787098348.879490:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098348.879517:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145a6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287893 expref: 9 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098348.879538:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d72038cde00) 00010000:00010000:0.0:1787098348.879543:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787098348.879834:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098348.879857:0:14483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878f5 expref: 5 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098348.879865:0:14483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098348.879909:0:14483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878f5 expref: 5 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098348.879923:0:14483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878f5 expref: 5 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098348.879937:0:14483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227486a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14483:1873908077794432:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098348.881247:0:14483:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828900 going to sleep for 11 seconds 00000100:00100000:0.0:1787098348.888691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098348.889347:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059979648 00000100:00100000:1.0:1787098348.889357:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059979648 00010000:00010000:1.0:1787098348.889406:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878f5 expref: 6 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098348.889442:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1787098348.889451:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41ff0bcc-bd57-401b-b53f-69920533991a+6:2373:x1873908059979648:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098348.889466:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098348.889473:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878f5 expref: 6 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.889486:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878f5 expref: 6 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.889509:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d72038cde00) 00010000:00010000:1.0:1787098348.889515:0:14470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.889523:0:14470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.889548:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.889567:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098348.889618:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41ff0bcc-bd57-401b-b53f-69920533991a+6:2373:x1873908059979648:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 168us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098348.889626:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00080000:2.0:1787098348.891543:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787098348.893095:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145aa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52878f5 expref: 5 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098348.893186:0:14483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227486a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14483:1873908077794432:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098348.893211:0:14483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.893221:0:14483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.893226:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.893254:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.893265:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.893274:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098348.894831:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787098348.894845:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.894854:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.894862:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.894867:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098348.894871:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.894877:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.894902:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d72038cde00) 00010000:00010000:3.0:1787098348.894905:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098348.894909:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098348.894915:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145b3f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787098348.894936:0:14483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2bc98fc reply state 000000002871ac25 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098348.894946:0:14483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787098348.895048:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+10:14473:x1873908059979520:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 15612us (16831us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787098348.895068:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00010000:00010000:2.0:1787098348.901941:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.901958:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.901965:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.901971:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098348.901975:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.901982:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.902025:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d7207e92800) 00010000:00010000:2.0:1787098348.902028:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098348.902033:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098348.902038:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6600/0xb1d871f9b0145b46 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098348.989765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098348.989910:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059979776 00000100:00100000:1.0:1787098348.989920:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059979776 00000100:00100000:1.0:1787098348.990025:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1787098348.990036:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:14481:x1873908059979776:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:1.0:1787098348.990059:0:15191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098348.990084:0:15191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528791f expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.990151:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145b54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.990164:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145b54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.990174:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145b54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098348.990234:0:15191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787098348.990238:0:15191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787098348.990311:0:15191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145b54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.990355:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528791f expref: 11 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.990377:0:15191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413200/0xb1d871f9b0145b54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528791f expref: 10 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098348.990385:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7fc00) 00010000:00010000:1.0:1787098348.990387:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787098348.990391:0:15191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413200, rc 0) 00000100:00100000:1.0:1787098348.990459:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+10:14481:x1873908059979776:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 425us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098348.990466:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1787098349.026123:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098349.026258:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059979904 00000100:00100000:3.0:1787098349.026269:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059979904 00000100:00100000:3.0:1787098349.026359:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1787098349.026370:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41ff0bcc-bd57-401b-b53f-69920533991a+5:14482:x1873908059979904:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098349.026393:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098349.026413:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287926 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.026490:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.026504:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.026614:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098349.026674:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787098349.026678:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098349.026700:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.026725:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287926 expref: 7 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.026746:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6c00/0xb1d871f9b0145b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287926 expref: 6 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.026776:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7fc00) 00010000:00010000:3.0:1787098349.026779:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098349.026782:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6c00, rc 0) 00000100:00100000:3.0:1787098349.026842:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41ff0bcc-bd57-401b-b53f-69920533991a+6:14482:x1873908059979904:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 474us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098349.026850:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1787098349.029795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098349.029908:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059980032 00000100:00100000:3.0:1787098349.029921:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059980032 00000100:00100000:3.0:1787098349.030028:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1787098349.030039:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+6:14482:x1873908059980032:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098349.030059:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098349.030076:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528792d expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030144:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030158:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030170:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030183:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030189:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030213:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030351:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145b7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030360:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145b7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030367:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145b7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098349.030407:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787098349.030411:0:14485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098349.030448:0:14485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145b7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030461:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030467:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030473:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030479:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098349.030483:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030490:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030520:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7fc00) 00010000:00010000:3.0:1787098349.030523:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098349.030529:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030535:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145b70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030551:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030557:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030562:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030566:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098349.030569:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030575:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030582:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d7207e92200) 00010000:00010000:3.0:1787098349.030584:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098349.030587:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030593:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145b77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030635:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528792d expref: 8 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030650:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145b7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528792d expref: 7 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.030657:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d7207e92700) 00010000:00010000:3.0:1787098349.030659:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098349.030662:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6000, rc 0) 00000100:00100000:3.0:1787098349.030728:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+7:14482:x1873908059980032:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 690us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098349.030736:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1787098349.034608:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098349.034744:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059980288 00000100:00100000:3.0:1787098349.034756:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059980288 00000100:00100000:3.0:1787098349.034825:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1787098349.034836:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41ff0bcc-bd57-401b-b53f-69920533991a+7:14482:x1873908059980288:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098349.034857:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098349.034878:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145b85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287934 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098349.035038:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787098349.035173:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145b85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287934 expref: 9 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.035188:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7fc00) 00010000:00010000:3.0:1787098349.035190:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098349.035207:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145b85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287934 expref: 9 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.035221:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6800, rc 0) 00000100:00100000:3.0:1787098349.035317:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41ff0bcc-bd57-401b-b53f-69920533991a+8:14482:x1873908059980288:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 483us (719us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787098349.035326:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1787098349.038188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098349.038352:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059980544 00000100:00100000:1.0:1787098349.038363:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059980544 00000100:00100000:1.0:1787098349.039148:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1787098349.039163:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41ff0bcc-bd57-401b-b53f-69920533991a+8:14482:x1873908059980544:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:1.0:1787098349.039227:0:15191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098349.039254:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6000/0xb1d871f9b0145b7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528792d expref: 8 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.039303:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d7207e92700) 00010000:00010000:1.0:1787098349.039315:0:15191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787098349.039343:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.039357:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.039387:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787098349.039700:0:15191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023613751 reply state 00000000f5eda068 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098349.039710:0:15191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787098349.039724:0:15191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787098349.040179:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41ff0bcc-bd57-401b-b53f-69920533991a+9:14482:x1873908059980544:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 1019us (1998us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787098349.040187:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00010000:00010000:3.0:1787098349.042940:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.042970:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.042979:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.042993:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098349.043329:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.043340:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.043358:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d7208d7f800) 00010000:00010000:3.0:1787098349.043361:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787098349.043366:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.043373:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145b93 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098349.044483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098349.044587:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059980800 00000100:00100000:2.0:1787098349.044599:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059980800 00000100:00100000:2.0:1787098349.044660:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1787098349.044673:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41ff0bcc-bd57-401b-b53f-69920533991a+8:14482:x1873908059980800:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1787098349.045189:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41ff0bcc-bd57-401b-b53f-69920533991a+9:14482:x1873908059980800:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 518us (711us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787098349.045198:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1787098349.048631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098349.048711:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059981056 00000100:00100000:3.0:1787098349.048735:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059981056 00000100:00100000:3.0:1787098349.048798:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:3.0:1787098349.048809:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41ff0bcc-bd57-401b-b53f-69920533991a+9:14482:x1873908059981056:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098349.048835:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098349.048857:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528793b expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.048947:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.048973:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.048994:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049016:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049024:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049030:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098349.049175:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787098349.049332:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049341:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049359:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049366:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098349.049371:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049380:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049392:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7fc00) 00010000:00010000:3.0:1787098349.049396:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098349.049400:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049412:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7600/0xb1d871f9b0145ba1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049428:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049435:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049440:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049446:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098349.049449:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049464:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049472:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d7207e92200) 00010000:00010000:3.0:1787098349.049474:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098349.049477:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049482:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145ba8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049528:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528793b expref: 11 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049538:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7fc00) 00010000:00010000:3.0:1787098349.049540:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098349.049544:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145b9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528793b expref: 11 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.049553:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c7200, rc 0) 00000100:00100000:3.0:1787098349.049622:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41ff0bcc-bd57-401b-b53f-69920533991a+10:14482:x1873908059981056:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 814us (1012us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787098349.049629:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1787098349.052689:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098349.052775:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059981184 00000100:00100000:3.0:1787098349.052785:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059981184 00000100:00100000:3.0:1787098349.052845:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:3.0:1787098349.052855:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+10:14482:x1873908059981184:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098349.052907:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098349.052932:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145bb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287942 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.053234:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.053249:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.053260:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098349.053345:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787098349.053350:0:14485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787098349.053375:0:14485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.053403:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145bb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287942 expref: 12 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.053421:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287942 expref: 11 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.053429:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:3.0:1787098349.053431:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787098349.053435:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6e00, rc 0) 00000100:00100000:3.0:1787098349.053499:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+11:14482:x1873908059981184:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 645us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098349.053506:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:0.0:1787098349.057825:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098349.057914:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059981312 00000100:00100000:3.0:1787098349.057925:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059981312 00000100:00100000:3.0:1787098349.058191:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:3.0:1787098349.058206:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41ff0bcc-bd57-401b-b53f-69920533991a+11:14482:x1873908059981312:12345-192.168.204.51@tcp:37:lfs.0 00000100:00100000:2.0:1787098349.065506:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41ff0bcc-bd57-401b-b53f-69920533991a+11:14482:x1873908059981312:12345-192.168.204.51@tcp:37:lfs.0 Request processed in 7292us (7677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098349.065521:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1787098349.070008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098349.070085:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059981568 00000100:00100000:2.0:1787098349.070096:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059981568 00000100:00100000:2.0:1787098349.070153:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:2.0:1787098349.070161:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204970c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41ff0bcc-bd57-401b-b53f-69920533991a+11:14482:x1873908059981568:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1787098349.070453:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204970c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41ff0bcc-bd57-401b-b53f-69920533991a+12:14482:x1873908059981568:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 291us (463us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787098349.070460:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1787098349.122572:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098349.122728:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059981696 00000100:00100000:1.0:1787098349.122740:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059981696 00000100:00100000:1.0:1787098349.122856:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:1.0:1787098349.122877:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+10:14488:x1873908059981696:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1787098349.122912:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098349.122937:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287949 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123022:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123037:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123049:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123065:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123088:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123094:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123207:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145bd9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123216:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123223:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098349.123254:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787098349.123258:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787098349.123325:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123338:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123344:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123350:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123355:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098349.123359:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123375:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123387:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7fc00) 00010000:00010000:1.0:1787098349.123389:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098349.123394:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123399:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145bcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123414:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123419:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123424:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123429:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412e00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098349.123432:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123437:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123444:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d7208d7f300) 00010000:00010000:1.0:1787098349.123446:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098349.123449:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123464:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123498:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287949 expref: 12 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123513:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412600/0xb1d871f9b0145bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287949 expref: 11 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.123520:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:1.0:1787098349.123523:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787098349.123525:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412600, rc 0) 00000100:00100000:1.0:1787098349.123598:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+11:14488:x1873908059981696:12345-192.168.204.51@tcp:101:bash.0 Request processed in 732us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098349.123606:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1787098349.128178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098349.128542:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059981952 00000100:00100000:1.0:1787098349.128552:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059981952 00000100:00100000:1.0:1787098349.128617:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1787098349.128627:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+11:14488:x1873908059981952:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1787098349.128648:0:15191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098349.128668:0:15191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145be0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287950 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.128803:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.129408:0:15191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287942 expref: 11 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.129432:0:15191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.129474:0:15191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287942 expref: 11 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.129488:0:15191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287942 expref: 11 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098349.129503:0:15191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15191:1873908077794560:192.168.204.51@tcp:104: 00000100:00100000:1.0:1787098349.129701:0:15191:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7241a66a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787098349.132455:0:15191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15191:1873908077794560:192.168.204.51@tcp:104: 00010000:00010000:1.0:1787098349.132487:0:15191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098349.132895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098349.133332:0:16598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059982080 00000100:00100000:0.0:1787098349.133341:0:16598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059982080 00010000:00010000:0.0:1787098349.133380:0:16598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287942 expref: 12 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098349.133443:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1787098349.133452:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41ff0bcc-bd57-401b-b53f-69920533991a+12:2374:x1873908059982080:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098349.133466:0:16598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098349.133473:0:16598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287942 expref: 12 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.133484:0:16598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287942 expref: 12 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.133505:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6e00/0xb1d871f9b0145bbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287942 expref: 12 pid: 14485 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.133523:0:16598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:0.0:1787098349.133527:0:16598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.133536:0:16598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.133544:0:16598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.133708:0:16598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098349.133767:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41ff0bcc-bd57-401b-b53f-69920533991a+11:2374:x1873908059982080:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 316us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098349.133775:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00010000:00010000:1.0:1787098349.134583:0:15191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.134595:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.134712:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.134723:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.134731:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137573:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137591:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137615:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098349.137627:0:15191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787098349.137664:0:15191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137671:0:15191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137677:0:15191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137683:0:15191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:1.0:1787098349.137687:0:15191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137694:0:15191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137705:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:1.0:1787098349.137708:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787098349.137712:0:15191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137732:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145be7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787098349.137750:0:15191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a40bcbe reply state 00000000b4c2c65a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098349.137758:0:15191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787098349.137794:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145be0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287950 expref: 14 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137808:0:15191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287950 expref: 13 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.137815:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:1.0:1787098349.137817:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787098349.137819:0:15191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412e00, rc 0) 00000100:00100000:1.0:1787098349.137907:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+14:14488:x1873908059981952:12345-192.168.204.51@tcp:101:bash.0 Request processed in 9280us (9738us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787098349.137916:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00010000:00010000:2.0:1787098349.140574:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.140594:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.140614:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.140622:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098349.140627:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.140634:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.140651:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d7208d7f300) 00010000:00010000:2.0:1787098349.140662:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098349.140667:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.140673:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412000/0xb1d871f9b0145bee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098349.154910:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098349.155317:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059982208 00000100:00100000:0.0:1787098349.155342:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059982208 00000100:00100000:0.0:1787098349.155411:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:0.0:1787098349.155422:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+13:14488:x1873908059982208:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1787098349.155456:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098349.155487:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287957 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.155555:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.155569:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.155580:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098349.155620:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787098349.155624:0:14483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098349.155644:0:14483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.155665:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.155691:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c03 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287957 expref: 15 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.155710:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287957 expref: 14 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.155718:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:0.0:1787098349.155726:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098349.155729:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204e800, rc 0) 00000100:00100000:0.0:1787098349.155789:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+14:14488:x1873908059982208:12345-192.168.204.51@tcp:101:bash.0 Request processed in 369us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098349.155796:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1787098349.159114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098349.159440:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059982464 00000100:00100000:2.0:1787098349.159453:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059982464 00000100:00100000:2.0:1787098349.159562:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1787098349.159573:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+14:14488:x1873908059982464:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1787098349.159963:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+15:14488:x1873908059982464:12345-192.168.204.51@tcp:35:bash.0 Request processed in 383us (850us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787098349.159972:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1787098349.257594:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098349.258109:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059982720 00000100:00100000:3.0:1787098349.258122:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059982720 00000100:00100000:3.0:1787098349.258211:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:3.0:1787098349.258224:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+15:14498:x1873908059982720:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1787098349.258258:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098349.258327:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528795e expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098349.258489:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787098349.258653:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528795e expref: 17 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.258685:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7208d7fc00) 00010000:00010000:3.0:1787098349.258689:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098349.258695:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528795e expref: 17 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.258715:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6800, rc 0) 00000100:00100000:3.0:1787098349.258810:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+16:14498:x1873908059982720:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 589us (1231us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787098349.258836:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:3.0:1787098349.264038:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098349.264228:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059982976 00000100:00100000:1.0:1787098349.264241:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059982976 00000100:00100000:1.0:1787098349.264481:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1787098349.264497:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+16:14498:x1873908059982976:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1787098349.264901:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+17:14498:x1873908059982976:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 407us (1124us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787098349.264913:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1787098349.314561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098349.314692:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059983232 00000100:00100000:0.0:1787098349.314711:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059983232 00000100:00100000:0.0:1787098349.314813:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1787098349.314826:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+17:14501:x1873908059983232:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1787098349.314862:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098349.314902:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145c1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287965 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.315048:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.315065:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.315079:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098349.315094:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787098349.316539:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145c1f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287965 expref: 20 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.316963:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287965 expref: 19 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.316998:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:0.0:1787098349.317002:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098349.317007:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204fa00, rc 0) 00000100:00100000:0.0:1787098349.317403:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+19:14501:x1873908059983232:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 2578us (2849us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787098349.317414:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1787098349.325568:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098349.325631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098349.325778:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059983360 00000100:00100000:3.0:1787098349.325791:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059983360 00000100:00100000:3.0:1787098349.325868:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:3.0:1787098349.325897:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+19:14501:x1873908059983360:12345-192.168.204.51@tcp:54:lfs.0 00000100:00100000:1.0:1787098349.326148:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059983488 00000100:00100000:1.0:1787098349.326171:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059983488 00010000:00010000:3.0:1787098349.326269:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098349.326362:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1787098349.326372:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+20:2376:x1873908059983488:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787098349.326386:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098349.326420:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287965 expref: 20 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.326445:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:1.0:1787098349.326452:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098349.326464:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.326481:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098349.326536:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+19:2376:x1873908059983488:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 166us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098349.326544:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00010000:00010000:3.0:1787098349.326945:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.326956:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.326964:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.326971:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c6800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098349.326977:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.327043:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.327067:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:3.0:1787098349.327197:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787098349.327265:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.327274:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.327453:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787098349.327707:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+18:14501:x1873908059983360:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 1825us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098349.327718:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1787098349.331920:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098349.332528:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059983744 00000100:00100000:2.0:1787098349.332538:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059983744 00000100:00100000:2.0:1787098349.332589:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1787098349.332599:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+18:14501:x1873908059983744:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1787098349.332864:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+19:14501:x1873908059983744:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 265us (954us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787098349.332873:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098349.607448:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098349.607656:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059984000 00000100:00100000:1.0:1787098349.607666:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059984000 00000100:00100000:1.0:1787098349.607729:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1787098349.607739:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+19:14532:x1873908059984000:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1787098349.607767:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098349.607789:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c3b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528796c expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.607915:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145c42 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.607929:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145c42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.607940:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145c42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787098349.607963:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787098349.608232:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c3b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528796c expref: 22 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.608253:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145c42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528796c expref: 21 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.608262:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:1.0:1787098349.608265:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787098349.608268:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227412200, rc 0) 00000100:00100000:1.0:1787098349.608509:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+21:14532:x1873908059984000:12345-192.168.204.51@tcp:101:cat.0 Request processed in 769us (1069us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787098349.608516:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1787098349.614677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098349.614941:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059984256 00000100:00100000:2.0:1787098349.614953:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059984256 00000100:00100000:2.0:1787098349.615064:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1787098349.615075:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+21:14532:x1873908059984256:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:2.0:1787098349.615435:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+22:14532:x1873908059984256:12345-192.168.204.51@tcp:35:cat.0 Request processed in 361us (765us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787098349.615444:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1787098349.616187:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098349.616418:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059984384 00000100:00100000:0.0:1787098349.616426:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059984384 00000100:00100000:0.0:1787098349.616483:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1787098349.616493:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+22:2376:x1873908059984384:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098349.616506:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098349.616533:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412200/0xb1d871f9b0145c42 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528796c expref: 22 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098349.616566:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:0.0:1787098349.616572:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098349.616607:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+21:2376:x1873908059984384:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 117us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098349.616616:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000040:00080000:0.0:1787098349.648078:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787098349.709889:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098349.713561:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059984640 00000100:00100000:2.0:1787098349.713578:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059984640 00000100:00100000:3.0:1787098349.713948:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1787098349.713960:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+21:14538:x1873908059984640:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:3.0:1787098349.714564:0:15191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787098349.715048:0:15191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145c50 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287973 expref: -99 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.715171:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.715189:0:15191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287950 expref: 22 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.715197:0:15191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287957 expref: 22 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.715227:0:15191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.715266:0:15191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287957 expref: 22 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.715311:0:15191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287957 expref: 22 pid: 14483 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098349.715326:0:15191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15191:1873908077794688:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098349.717746:0:15191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287950 expref: 22 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.717912:0:15191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287950 expref: 22 pid: 15191 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098349.717931:0:15191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7105a8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15191:1873908077794816:192.168.204.51@tcp:104: 00000100:00100000:3.0:1787098349.718584:0:15191:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72049fe900 going to sleep for 11 seconds 00000100:00100000:0.0:1787098349.732573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098349.732631:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098349.733226:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059984768 00000100:00100000:2.0:1787098349.733237:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059984768 00010000:00010000:2.0:1787098349.733320:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287957 expref: 23 pid: 14483 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098349.733380:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059984896 00000100:00100000:2.0:1787098349.733384:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059984896 00010000:00010000:2.0:1787098349.733400:0:14470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287950 expref: 24 pid: 15191 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098349.733428:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1787098349.733437:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:2373:x1873908059984768:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098349.733455:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098349.733462:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287957 expref: 24 pid: 14483 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.733474:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287957 expref: 24 pid: 14483 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.733509:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:2.0:1787098349.733514:0:14470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.733522:0:14470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.733529:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098349.733584:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207b18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:2373:x1873908059984768:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 148us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098349.733604:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1787098349.733655:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1787098349.733662:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+23:2373:x1873908059984896:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098349.733676:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098349.733682:0:14470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287950 expref: 23 pid: 15191 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.733692:0:14470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287950 expref: 23 pid: 15191 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.733704:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:2.0:1787098349.733708:0:14470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.733715:0:14470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.733722:0:14470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.733738:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098349.733766:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+23:2373:x1873908059984896:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 105us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098349.733773:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00010000:00010000:3.0:1787098349.734445:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c0a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287957 expref: 22 pid: 14483 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098349.734469:0:15191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15191:1873908077794688:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098349.734482:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412e00/0xb1d871f9b0145bf5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287950 expref: 21 pid: 15191 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098349.734522:0:15191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7105a8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15191:1873908077794816:192.168.204.51@tcp:104: 00010000:00010000:3.0:1787098349.734547:0:15191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.734557:0:15191:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.734562:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787098349.734582:0:15191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787098349.734774:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145c50 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287973 expref: 22 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.734792:0:15191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c6800/0xb1d871f9b0145c57 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287973 expref: 21 pid: 15191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.734801:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:3.0:1787098349.734804:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787098349.734806:0:15191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d72421c6800, rc 0) 00000100:00100000:3.0:1787098349.734844:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+21:14538:x1873908059984640:12345-192.168.204.51@tcp:101:dd.0 Request processed in 20886us (24976us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787098349.734852:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1787098349.743266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098349.743815:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059985152 00000100:00100000:1.0:1787098349.743826:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059985152 00000100:00100000:1.0:1787098349.743899:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1787098349.743910:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+21:14538:x1873908059985152:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:1.0:1787098349.744465:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.744487:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.744570:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787098349.744721:0:14484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787098349.744837:0:14484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8f747d3 reply state 0000000026871c02 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098349.744846:0:14484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787098349.745088:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14538:x1873908059985152:12345-192.168.204.51@tcp:36:dd.0 Request processed in 1178us (1829us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787098349.745096:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000020:00080000:1.0:1787098349.745102:0:14484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787098349.747380:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.747398:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.747417:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.747424:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098349.747428:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.747436:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.747458:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:3.0:1787098349.747461:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098349.747465:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098349.747472:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227412400/0xb1d871f9b0145c65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098349.749177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098349.749265:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059985280 00000100:00100000:2.0:1787098349.749275:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059985280 00000100:00100000:2.0:1787098349.749348:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:2.0:1787098349.749358:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+23:14538:x1873908059985280:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:2.0:1787098349.749395:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098349.749420:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36600/0xb1d871f9b0145c6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528797a expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.749509:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36600/0xb1d871f9b0145c6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528797a expref: 24 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.749525:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36600/0xb1d871f9b0145c6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528797a expref: 24 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.749544:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:2.0:1787098349.749547:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098349.749550:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b36600, rc 0) 00000100:00100000:2.0:1787098349.749613:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14538:x1873908059985280:12345-192.168.204.51@tcp:101:dd.0 Request processed in 257us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098349.749620:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:2.0:1787098349.762573:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098349.762730:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059985536 00000100:00100000:1.0:1787098349.762740:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059985536 00000100:00100000:1.0:1787098349.762919:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1787098349.762930:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14538:x1873908059985536:12345-192.168.204.51@tcp:103:dd.0 00010000:00010000:1.0:1787098349.762947:0:14470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787098349.762982:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36600/0xb1d871f9b0145c6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528797a expref: 24 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.763003:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:1.0:1787098349.763008:0:14470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787098349.763068:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+23:14538:x1873908059985536:12345-192.168.204.51@tcp:103:dd.0 Request processed in 140us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098349.763075:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1787098349.766163:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098349.766246:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059985664 00000100:00100000:0.0:1787098349.766256:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059985664 00000100:00100000:0.0:1787098349.766387:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1787098349.766398:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+23:14538:x1873908059985664:12345-192.168.204.51@tcp:58:dd.0 00010000:00010000:1.0:1787098349.766573:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.766591:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098349.766613:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787098349.767903:0:14483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787098349.768621:0:14483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787098349.768700:0:14483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787098349.768835:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+23:14538:x1873908059985664:12345-192.168.204.51@tcp:58:dd.0 Request processed in 2434us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098349.768847:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1787098349.773854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098349.775318:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059985792 00000100:00100000:2.0:1787098349.775331:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059985792 00000100:00100000:2.0:1787098349.775624:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:2.0:1787098349.775637:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+23:14538:x1873908059985792:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:2.0:1787098349.775662:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098349.775685:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36000/0xb1d871f9b0145c7a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287981 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.775747:0:14485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.775936:0:14485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36000/0xb1d871f9b0145c7a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287981 expref: 24 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.775981:0:14485:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.775997:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36000/0xb1d871f9b0145c7a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287981 expref: 24 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.776009:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:2.0:1787098349.776012:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098349.776016:0:14485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36000/0xb1d871f9b0145c7a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287981 expref: 24 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098349.776023:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b36000, rc 0) 00000100:00100000:2.0:1787098349.776194:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14538:x1873908059985792:12345-192.168.204.51@tcp:101:dd.0 Request processed in 560us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098349.776202:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:2.0:1787098350.100512:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098350.100565:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098350.100599:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098350.100638:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098350.100655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098350.100682:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059986304 00000100:00100000:2.0:1787098350.100690:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059986304 00000100:00100000:2.0:1787098350.100734:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059986560 00000100:00100000:2.0:1787098350.100736:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059986560 00000100:00100000:2.0:1787098350.100747:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059986176 00000100:00100000:2.0:1787098350.100749:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059986176 00000100:00100000:2.0:1787098350.100777:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1787098350.100800:0:15169:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787098350.100803:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2376:x1873908059986304:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1787098350.100813:0:15169:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1787098350.100852:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787098350.100856:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787098350.100896:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2376:x1873908059986304:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 95us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098350.100904:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1787098350.100929:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1787098350.100933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098350.100941:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41ff0bcc-bd57-401b-b53f-69920533991a+5:2376:x1873908059986560:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098350.100983:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41ff0bcc-bd57-401b-b53f-69920533991a+5:2376:x1873908059986560:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098350.100989:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1787098350.101003:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1787098350.101010:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2376:x1873908059986176:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098350.101036:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2376:x1873908059986176:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098350.101042:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1787098350.101899:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059985920 00000100:00100000:1.0:1787098350.101907:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059985920 00000100:00100000:1.0:1787098350.101954:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1787098350.101962:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:2376:x1873908059985920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1787098350.106191:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059986048 00000100:00100000:3.0:1787098350.106207:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059986048 00000100:00100000:3.0:1787098350.106307:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059986432 00000100:00100000:3.0:1787098350.106312:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059986432 00000100:00100000:3.0:1787098350.106342:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:3.0:1787098350.106353:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:2376:x1873908059986048:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:0.0:1787098350.107923:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787098350.107941:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098350.107973:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059986688 00000100:00100000:2.0:1787098350.107982:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059986688 00000100:00080000:0.0:1787098350.108040:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787098350.108042:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1787098350.108054:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41ff0bcc-bd57-401b-b53f-69920533991a+5:2376:x1873908059986688:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098350.108110:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41ff0bcc-bd57-401b-b53f-69920533991a+5:2376:x1873908059986688:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 58us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098350.108117:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1787098350.108170:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1787098350.108180:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+11:2376:x1873908059986432:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1787098350.108228:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41ff0bcc-bd57-401b-b53f-69920533991a+11:2376:x1873908059986432:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 50us (7303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098350.108235:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1787098350.108798:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f218450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9710efb3-276e-45a2-a075-9c71c786ced4+13:2376:x1873908059985920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 6690us (8012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098350.108810:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:3.0:1787098350.112603:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:2376:x1873908059986048:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 6236us (12087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098350.112624:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00010000:00010000:3.0:1787098350.351943:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787098350.671574:0:14517:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787098350.671781:0:14517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787098350.671954:0:14517:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787098350.671962:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787098350.672106:0:14517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227486a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14517:1873908077794944:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787098350.672221:0:14517:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828540 going to sleep for 11 seconds 00000100:00100000:0.0:1787098350.688927:0:14517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227486a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14517:1873908077794944:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787098350.695912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098350.696875:0:14494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059986816 00000100:00100000:3.0:1787098350.696896:0:14494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059986816 00000100:00100000:3.0:1787098350.696981:0:14494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1787098350.696995:0:14494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14540:x1873908059986816:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787098350.697795:0:14494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14540:x1873908059986816:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 Request processed in 796us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098350.697806:0:14494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1787098350.702845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.703152:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059986944 00000100:00100000:0.0:1787098350.703167:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059986944 00000100:00100000:0.0:1787098350.703308:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1787098350.703322:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14540:x1873908059986944:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787098350.703376:0:14483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787098350.703562:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14540:x1873908059986944:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 232us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.703573:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1787098350.710987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.711220:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059987072 00000100:00100000:0.0:1787098350.711232:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059987072 00000100:00100000:0.0:1787098350.711339:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1787098350.711352:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14540:x1873908059987072:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787098350.711455:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711476:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711491:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711508:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711516:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711523:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711551:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711561:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711568:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098350.711638:0:15191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787098350.711643:0:15191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098350.711727:0:15191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711741:0:15191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711749:0:15191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711755:0:15191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711762:0:15191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204fa00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098350.711766:0:15191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711773:0:15191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711787:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d72085a6a00) 00010000:00010000:0.0:1787098350.711790:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098350.711794:0:15191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711800:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145c81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711817:0:15191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711833:0:15191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711839:0:15191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711844:0:15191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204ea00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098350.711847:0:15191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711868:0:15191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711877:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d72038cd100) 00010000:00010000:0.0:1787098350.711880:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098350.711883:0:15191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711889:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145c88 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711909:0:15191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711915:0:15191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711921:0:15191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711926:0:15191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:0.0:1787098350.711936:0:15191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711943:0:15191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711951:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:0.0:1787098350.711954:0:15191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787098350.711957:0:15191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.711963:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145c8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098350.712263:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14540:x1873908059987072:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 910us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.712274:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:1.0:1787098350.723914:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098350.724502:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059987328 00000100:00100000:2.0:1787098350.724518:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059987328 00000100:00100000:2.0:1787098350.725897:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:2.0:1787098350.725923:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+24:14540:x1873908059987328:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787098350.725963:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787098350.725994:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145c96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287988 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726136:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726157:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726172:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787098350.726187:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787098350.726355:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726365:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726395:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726401:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b37a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098350.726406:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726415:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726430:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:2.0:1787098350.726434:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787098350.726439:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726445:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37a00/0xb1d871f9b0145c9d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726503:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145c96 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287988 expref: 26 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726516:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d72085a6a00) 00010000:00010000:2.0:1787098350.726518:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787098350.726522:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36200/0xb1d871f9b0145c96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287988 expref: 26 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.726532:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7104b36200, rc 0) 00000100:00100000:2.0:1787098350.726644:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+25:14540:x1873908059987328:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 732us (2743us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787098350.728415:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:2.0:1787098350.731555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098350.731830:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059987456 00000100:00100000:3.0:1787098350.731844:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059987456 00000100:00100000:3.0:1787098350.731926:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:3.0:1787098350.731939:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+25:14540:x1873908059987456:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787098350.732026:0:14484:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787098350.732199:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+25:14540:x1873908059987456:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 262us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098350.732209:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:3.0:1787098350.739654:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.740137:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059987712 00000100:00100000:0.0:1787098350.740151:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059987712 00000100:00100000:0.0:1787098350.740231:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1787098350.740243:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+25:14540:x1873908059987712:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098350.740272:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098350.740330:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528798f expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787098350.741527:0:14483:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787098350.741537:0:14483:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787098350.741598:0:14483:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787098350.742515:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145cb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.742553:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.742569:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.742891:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528798f expref: 28 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.742918:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528798f expref: 27 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.742928:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cd100) 00010000:00010000:0.0:1787098350.742931:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787098350.742935:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204ea00, rc 0) 00000100:00100000:0.0:1787098350.743159:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+27:14540:x1873908059987712:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2916us (3517us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787098350.743170:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1787098350.748081:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098350.748210:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059987968 00000100:00100000:3.0:1787098350.748225:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059987968 00000100:00100000:3.0:1787098350.748400:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1787098350.748414:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+27:14540:x1873908059987968:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787098350.748499:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787098350.748538:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204ea00/0xb1d871f9b0145cb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528798f expref: 27 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748564:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cd100) 00010000:00010000:3.0:1787098350.748716:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787098350.748752:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748786:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748798:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748817:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748824:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748831:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748943:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748951:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748973:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748980:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098350.748986:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.748994:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.749003:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d7207e92500) 00010000:00010000:3.0:1787098350.749013:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098350.749018:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.749024:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7200/0xb1d871f9b0145cc0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.749039:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.749045:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.749051:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.749056:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098350.749059:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.749065:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.749074:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x33bbc414 (ffff8d7207e92200) 00010000:00010000:3.0:1787098350.749076:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098350.749080:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.749086:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d72421c7c00/0xb1d871f9b0145cc7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x33bbc414 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098350.749206:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+26:14540:x1873908059987968:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 793us (1139us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787098350.749220:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:2.0:1787098350.752656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.752773:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059988096 00000100:00100000:0.0:1787098350.752785:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059988096 00000100:00100000:0.0:1787098350.752911:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1787098350.752925:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+26:14540:x1873908059988096:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098350.753013:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098350.753047:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e5287996 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.753094:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145cd5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.753129:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.753143:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.753274:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287996 expref: 28 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.753368:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204fa00/0xb1d871f9b0145cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287996 expref: 27 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.753379:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cdf00) 00010000:00010000:0.0:1787098350.753382:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787098350.753385:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204fa00, rc 0) 00000100:00100000:0.0:1787098350.753515:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+27:14540:x1873908059988096:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 593us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.753523:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1787098350.757043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.757395:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059988352 00000100:00100000:0.0:1787098350.757409:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059988352 00000100:00100000:0.0:1787098350.757708:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:0.0:1787098350.757721:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+27:14540:x1873908059988352:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787098350.757841:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.757874:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.757913:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787098350.758487:0:15191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1787098350.758500:0:15191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449014219080ns, next at 450014215950ns, rc = 0 00000004:00010000:0.0:1787098350.758606:0:15191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c26ca848 reply state 00000000badda452 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098350.758618:0:15191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787098350.758770:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+29:14540:x1873908059988352:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1048us (1738us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1787098350.758779:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00010000:00010000:3.0:1787098350.761519:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.761542:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.761550:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.761558:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e200 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098350.761564:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.761573:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.761595:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cdf00) 00010000:00010000:3.0:1787098350.761599:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787098350.761605:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.761612:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cdc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098350.763252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098350.764047:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059988480 00000100:00100000:1.0:1787098350.764061:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059988480 00000100:00100000:1.0:1787098350.764154:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1787098350.764168:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d72417cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+28:14540:x1873908059988480:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787098350.764200:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787098350.764229:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e528799d expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098350.764333:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528799d expref: 29 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098350.764351:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528799d expref: 29 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098350.764390:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cdf00) 00010000:00010000:1.0:1787098350.764393:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787098350.764398:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7227413600, rc 0) 00000100:00100000:1.0:1787098350.764485:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d72417cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+29:14540:x1873908059988480:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 320us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098350.764493:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:2.0:1787098350.770267:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.770507:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059988608 00000100:00100000:0.0:1787098350.770520:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059988608 00000100:00100000:0.0:1787098350.770628:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1787098350.770641:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7241a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2373:x1873908059988608:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787098350.771275:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7241a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:2373:x1873908059988608:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 634us (1020us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787098350.772795:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1787098350.778741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098350.778913:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059988864 00000100:00100000:1.0:1787098350.778926:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059988864 00000100:00100000:1.0:1787098350.779012:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1787098350.779034:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723ba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+29:14540:x1873908059988864:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787098350.779430:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723ba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+30:14540:x1873908059988864:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 397us (706us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787098350.779440:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1787098350.785711:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.788089:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059989120 00000100:00100000:0.0:1787098350.788110:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059989120 00000100:00100000:0.0:1787098350.788335:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1787098350.788348:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+30:14540:x1873908059989120:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787098350.788837:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+30:14540:x1873908059989120:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 488us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.788860:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:3.0:1787098350.797611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.797946:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059989248 00000100:00100000:0.0:1787098350.797970:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059989248 00000100:00100000:0.0:1787098350.798053:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:0.0:1787098350.798066:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+30:14540:x1873908059989248:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098350.798095:0:14485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098350.798125:0:14485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52879a4 expref: -99 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.798228:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cf1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.798248:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.798262:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787098350.798368:0:14485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787098350.798396:0:14485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.798436:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879a4 expref: 32 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.798458:0:14485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879a4 expref: 31 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.798468:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cdf00) 00010000:00010000:0.0:1787098350.798471:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787098350.798475:0:14485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204e200, rc 0) 00000100:00100000:1.0:1787098350.798649:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+31:14540:x1873908059989248:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 582us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787098350.798659:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1787098350.803809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.804164:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059989376 00000100:00100000:0.0:1787098350.804310:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059989376 00000100:00100000:0.0:1787098350.804404:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1787098350.804417:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+6:2374:x1873908059989376:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787098350.804446:0:15169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787098350.804475:0:15169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0663b46e52879ab expref: -99 pid: 15169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787098350.805719:0:15169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a84f4ee, blocks: 0x1 00010000:00010000:0.0:1787098350.805768:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1787098350.805775:0:15169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098350.805793:0:15169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879ab expref: 7 pid: 15169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.805822:0:15169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879ab expref: 7 pid: 15169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.805858:0:15169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d724204ea00, rc 0) 00000100:00100000:0.0:1787098350.805957:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:2374:x1873908059989376:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1542us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.805968:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1787098350.821868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.822155:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059989632 00000100:00100000:0.0:1787098350.822169:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059989632 00000100:00100000:0.0:1787098350.822245:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1787098350.822257:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+31:14540:x1873908059989632:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787098350.822570:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+31:14540:x1873908059989632:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 314us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.822596:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:3.0:1787098350.826822:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098350.827036:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059989760 00000100:00100000:1.0:1787098350.827050:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059989760 00000100:00100000:1.0:1787098350.827139:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1787098350.827152:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+31:14540:x1873908059989760:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787098350.886993:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1787098350.887029:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787098350.887064:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1787098350.887085:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1787098350.887100:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787098350.887646:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+14:14540:x1873908059989760:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 60489us (60831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.887661:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1787098350.887705:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787098350.887724:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077795072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787098350.887796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098350.888770:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077795072 00000100:00100000:2.0:1787098350.888785:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077795072 00000100:00100000:2.0:1787098350.888920:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787098350.888933:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077795072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787098350.889181:0:15167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787098350.889185:0:15167:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787098350.889188:0:15167:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787098350.889190:0:15167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787098350 -> 1787098350 00002000:00010000:2.0:1787098350.889192:0:15167:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787098350.889717:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1873908077795072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 619us (1753us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787098350.889728:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787098350.889794:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787098350.889882:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7207df3800/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787098350.889891:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077795072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787098350.895592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.895709:0:16710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059989888 00000100:00100000:0.0:1787098350.895723:0:16710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059989888 00000100:00100000:0.0:1787098350.895803:0:16710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:0.0:1787098350.895815:0:16710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:2374:x1873908059989888:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787098350.895984:0:16710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:2374:x1873908059989888:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 171us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.895992:0:16710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1787098350.902202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.902529:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059990144 00000100:00100000:0.0:1787098350.902544:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059990144 00000100:00100000:0.0:1787098350.902733:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1787098350.902747:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+14:14540:x1873908059990144:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787098350.902829:0:15191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098350.902880:0:15191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e200/0xb1d871f9b0145cf1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879a4 expref: 14 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.902910:0:15191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cdf00) 00010000:00010000:0.0:1787098350.902917:0:15191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787098350.902984:0:15191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.903001:0:15191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.903013:0:15191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787098350.903276:0:15191:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cce756f reply state 00000000ce12876a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098350.903399:0:15191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787098350.903968:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+15:14540:x1873908059990144:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1219us (1775us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787098350.903979:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00010000:00010000:3.0:1787098350.908843:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.908880:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.908890:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.908897:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:3.0:1787098350.908902:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.908911:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.908936:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cdf00) 00010000:00010000:3.0:1787098350.908939:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787098350.908945:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098350.908961:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145cff lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098350.910190:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098350.910348:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059990272 00000100:00100000:3.0:1787098350.910363:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059990272 00000100:00100000:3.0:1787098350.910438:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1787098350.910450:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+7:2373:x1873908059990272:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787098350.910761:0:15170:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787098350.910765:0:15170:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787098349 00002000:00010000:3.0:1787098350.910767:0:15170:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787098349 00002000:00010000:3.0:1787098350.910770:0:15170:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787098350 -> 1787098349 00002000:00010000:3.0:1787098350.910772:0:15170:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787098350.910856:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+8:2373:x1873908059990272:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 396us (665us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787098350.910866:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1787098350.915550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.915663:0:16710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059990400 00000100:00100000:0.0:1787098350.915676:0:16710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059990400 00000100:00100000:0.0:1787098350.915750:0:16710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1787098350.915763:0:16710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+8:2373:x1873908059990400:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787098350.915825:0:16710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.915856:0:16710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098350.915862:0:16710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098350.915870:0:16710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.915886:0:16710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.915963:0:16710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.915974:0:16710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.915984:0:16710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.915991:0:16710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098350.915996:0:16710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.916006:0:16710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.916026:0:16710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.916033:0:16710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098350.916192:0:16710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+8:2373:x1873908059990400:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 429us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.916209:0:16710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1787098350.919032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098350.919185:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059990656 00000100:00100000:2.0:1787098350.919212:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059990656 00000100:00100000:2.0:1787098350.919330:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:2.0:1787098350.919343:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+14:14540:x1873908059990656:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787098350.919476:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.919497:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.919511:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.920024:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.920040:0:14485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e528799d expref: 15 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.920049:0:14485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.920094:0:14485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528799d expref: 15 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.920114:0:14485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528799d expref: 15 pid: 14483 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098350.920133:0:14485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e08700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14485:1873908077795200:192.168.204.51@tcp:104: 00000100:00100000:2.0:1787098350.920267:0:14485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d72048b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787098350.925564:0:14485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e08700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14485:1873908077795200:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098350.925615:0:14485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787098350.928747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.929141:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059990784 00000100:00100000:0.0:1787098350.929155:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059990784 00010000:00010000:0.0:1787098350.929263:0:14468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528799d expref: 16 pid: 14483 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098350.929442:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1787098350.929457:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+16:2373:x1873908059990784:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787098350.929478:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787098350.929488:0:14468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528799d expref: 16 pid: 14483 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.929505:0:14468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528799d expref: 16 pid: 14483 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.929536:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413600/0xb1d871f9b0145ce3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e528799d expref: 16 pid: 14483 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.929560:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cdf00) 00010000:00010000:0.0:1787098350.929675:0:14468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.929691:0:14468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.929701:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.929805:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787098350.929897:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+15:2373:x1873908059990784:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 443us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.929906:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00010000:00010000:2.0:1787098350.931735:0:14485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.931756:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098350.932112:0:14485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787098350.932443:0:14485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787098350.932497:0:14485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787098350.932716:0:14485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e08700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14485:1873908077795328:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787098350.932833:0:14485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098350.932971:0:14485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787098350.933100:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077795328 00000100:00100000:3.0:1787098350.933110:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077795328 00000100:00100000:3.0:1787098350.933223:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787098350.933237:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14485:x1873908077795328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787098350.933382:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14485:x1873908077795328:12345-0@lo:1000:mdt00_002.0 Request processed in 149us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098350.933391:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787098350.933484:0:14485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e08700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14485:1873908077795328:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787098350.934642:0:14485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787098350.934744:0:14485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e08700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14485:1873908077795456:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787098350.934810:0:14485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098350.936163:0:14485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828600 going to sleep for 11 seconds 00000100:00100000:0.0:1787098350.936270:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077795456 00000100:00100000:0.0:1787098350.936303:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077795456 00000100:00100000:0.0:1787098350.936365:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787098350.936376:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14485:x1873908077795456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787098350.936670:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14485:x1873908077795456:12345-0@lo:1000:mdt00_002.0 Request processed in 294us (1859us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787098350.936678:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787098350.936809:0:14485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e08700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14485:1873908077795456:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787098350.936868:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.936881:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.936889:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.936897:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b36a00 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098350.936910:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.936919:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.936940:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cdf00) 00010000:00010000:2.0:1787098350.936943:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098350.936949:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.936956:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36a00/0xb1d871f9b0145d14 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.936997:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.937004:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.937010:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.937015:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227413000 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098350.937018:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.937024:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.937033:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:2.0:1787098350.937036:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787098350.937050:0:14485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36000/0xb1d871f9b0145c7a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287981 expref: 18 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.937064:0:14485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36000/0xb1d871f9b0145c7a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287981 expref: 18 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.937075:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36000/0xb1d871f9b0145c7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287981 expref: 18 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.937142:0:14485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b36000/0xb1d871f9b0145c7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e5287981 expref: 18 pid: 14485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098350.937159:0:14485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7203e08000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14485:1873908077795584:192.168.204.51@tcp:105: 00000100:00100000:2.0:1787098350.937339:0:14485:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d7206828240 going to sleep for 11 seconds 00000100:00100000:3.0:1787098350.943233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.943381:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059990912 00000100:00100000:0.0:1787098350.943394:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059990912 00000100:00100000:0.0:1787098350.943461:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1787098350.943471:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7204970450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+19:14538:x1873908059990912:12345-192.168.204.51@tcp:49:dd.0 00000100:00100000:0.0:1787098350.943667:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7204970450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+19:14538:x1873908059990912:12345-192.168.204.51@tcp:49:dd.0 Request processed in 196us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098350.943676:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1787098350.949447:0:14485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7203e08000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14485:1873908077795584:192.168.204.51@tcp:105: 00010000:00010000:2.0:1787098350.949494:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.949507:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7227413000/0xb1d871f9b0145c73 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.949561:0:14485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950025:0:14485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950042:0:14485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950079:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950086:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950093:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950101:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b37800 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098350.950105:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950114:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950126:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:2.0:1787098350.950129:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787098350.950133:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950139:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37800/0xb1d871f9b0145d1b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950153:0:14485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950159:0:14485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950166:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950245:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b37400 already unused, calling callback (ffffffffc21404f0) 00010000:00010000:2.0:1787098350.950249:0:14485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950255:0:14485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950265:0:14485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d7208d7fb00) 00010000:00010000:2.0:1787098350.950267:0:14485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787098350.950270:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098350.950276:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7104b37400/0xb1d871f9b0145d0d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098350.951105:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+18:14540:x1873908059990656:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 31758us (32081us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787098350.951119:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000020:00080000:2.0:1787098350.951127:0:14485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787098350.951927:0:14517:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787098350.951935:0:14517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787098350.951993:0:14517:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787098350.952000:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787098350.967147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098350.967328:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059991168 00000100:00100000:0.0:1787098350.967343:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059991168 00000100:00100000:0.0:1787098350.967418:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1787098350.967430:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7105a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+18:14540:x1873908059991168:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787098350.968488:0:14486:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787098350.968637:0:14486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787098350.968697:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.968719:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.968733:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.968743:0:14486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.968750:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.968757:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098350.968789:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787098350.969182:0:14472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787098350.969193:0:14472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098350.969203:0:14472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098350.969208:0:14472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098350.969217:0:14472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098350.969234:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d72038cdf00) 00010000:00010000:1.0:1787098350.969238:0:14472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787098350.969243:0:14472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098350.969249:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d724204e800/0xb1d871f9b0145d22 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098350.969269:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098350.969272:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787098350.969273:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098350.969853:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7105a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+20:14540:x1873908059991168:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 2406us (2703us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787098350.969868:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000020:00080000:0.0:1787098350.969877:0:14486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787098351.121148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1787098351.121205:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1787098351.121656:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059991296 00000100:00100000:0.0:1787098351.121670:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059991296 00000100:00100000:0.0:1787098351.121759:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059991424 00000100:00100000:0.0:1787098351.121762:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059991424 00000100:00100000:0.0:1787098351.121784:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1787098351.121795:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:2376:x1873908059991296:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:0.0:1787098351.121866:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.121892:0:15173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879ab expref: 9 pid: 15169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.121902:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098351.121908:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098351.121913:0:15173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.121965:0:15173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879ab expref: 9 pid: 15169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.121980:0:15173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879ab expref: 9 pid: 15169 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098351.121998:0:15173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227487480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15173:1873908077795712:192.168.204.51@tcp:104: 00000100:00100000:0.0:1787098351.122132:0:15173:0:(client.c:2702:ptlrpc_set_wait()) set ffff8d720a7daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787098351.135076:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098351.135124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098351.135159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098351.135171:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098351.135183:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098351.135194:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1787098351.135262:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1787098351.135483:0:15175:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787098351.135495:0:15175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787098351.135965:0:15173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227487480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15173:1873908077795712:192.168.204.51@tcp:104: 00010000:00010000:2.0:1787098351.136002:0:15173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098351.136060:0:15174:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787098351.136080:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059991552 00000100:00100000:0.0:1787098351.136089:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059991552 00000100:00100000:0.0:1787098351.136145:0:15174:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787098351.136149:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059991680 00000100:00100000:0.0:1787098351.136152:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059991680 00000100:00100000:0.0:1787098351.136162:0:15174:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787098351.136166:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059991808 00000100:00100000:0.0:1787098351.136176:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059991808 00000100:00100000:0.0:1787098351.136189:0:15174:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787098351.136192:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059991936 00000100:00100000:0.0:1787098351.136195:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059991936 00000100:00100000:0.0:1787098351.136204:0:15174:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787098351.136208:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059992064 00000100:00100000:0.0:1787098351.136210:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059992064 00000100:00100000:0.0:1787098351.136220:0:15174:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787098351.136224:0:15174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059992192 00000100:00100000:0.0:1787098351.136226:0:15174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059992192 00000100:00100000:2.0:1787098351.137070:0:16598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908059992320 00000100:00100000:2.0:1787098351.137081:0:16598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908059992320 00010000:00010000:2.0:1787098351.137134:0:16598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879ab expref: 16 pid: 15169 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098351.137192:0:16598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1787098351.137210:0:16598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+16:2374:x1873908059992320:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787098351.137229:0:16598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787098351.137261:0:16598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879ab expref: 16 pid: 15169 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098351.137313:0:16598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879ab expref: 16 pid: 15169 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098351.137345:0:16598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145cf8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0xa0663b46e52879ab expref: 16 pid: 15169 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098351.137367:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098351.137373:0:16598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098351.137380:0:16598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098351.137397:0:16598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098351.137431:0:16598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787098351.137505:0:16598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+15:2374:x1873908059992320:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 303us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098351.137514:0:16598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00010000:00010000:0.0:1787098351.138242:0:15173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.138260:0:15173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787098351.146707:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1787098351.146735:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7203e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+15:2376:x1873908059991424:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:2.0:1787098351.146796:0:16712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098351.146819:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098351.146825:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787098351.146832:0:16712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787098351.146858:0:16712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787098351.280928:0:15173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1787098351.280940:0:15173:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787098349 -> 1787098351 00002000:00010000:1.0:1787098351.280943:0:15173:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787098349 -> 1787098351 00002000:00010000:1.0:1787098351.280946:0:15173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1787098351.280961:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.280976:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.280985:0:15173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.280992:0:15173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e800 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098351.280996:0:15173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.281005:0:15173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098351.281020:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:1.0:1787098351.281026:0:15173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098351.281035:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00010000:00010000:1.0:1787098351.281035:0:15173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001968c694/0xb1d871f9b0145d29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098351.281047:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:1.0:1787098351.281174:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+15:2376:x1873908059991296:12345-192.168.204.51@tcp:4:dd.0 Request processed in 159375us (160034us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787098351.281209:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1787098351.281246:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1787098351.281261:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+14:2375:x1873908059991552:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:1.0:1787098351.281329:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.281343:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098351.281348:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787098351.281356:0:15173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.281368:0:15173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787098351.326786:0:16712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1787098351.326795:0:16712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1787098351.326809:0:16712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.326824:0:16712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.326860:0:16712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.326869:0:16712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7104b37c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098351.326874:0:16712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.326883:0:16712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.326903:0:16712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.326910:0:16712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f33a759/0xb1d871f9b0145d30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098351.327501:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7203e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+16:2376:x1873908059991424:12345-192.168.204.51@tcp:4:dd.0 Request processed in 180771us (206288us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787098351.327513:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1787098351.327550:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:3.0:1787098351.327563:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7207df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+15:2375:x1873908059991680:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:3.0:1787098351.327600:0:16712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.327613:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098351.327624:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098351.327631:0:16712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.327643:0:16712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787098351.327777:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00010000:00010000:1.0:1787098351.375568:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787098351.388208:0:15173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:3.0:1787098351.388219:0:15173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1787098351.388235:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.388251:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.388261:0:15173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.388269:0:15173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7227412000 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098351.388273:0:15173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.388305:0:15173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.388327:0:15173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.388355:0:15173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002da06e4e/0xb1d871f9b0145d37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098351.388496:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+15:2375:x1873908059991552:12345-192.168.204.51@tcp:4:dd.0 Request processed in 107234us (253430us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787098351.388507:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1787098351.388558:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1787098351.388644:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+14:2375:x1873908059991808:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:3.0:1787098351.388680:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.388692:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098351.388697:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098351.388703:0:15173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.388714:0:15173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787098351.389245:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1787098351.442140:0:16712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1787098351.442157:0:16712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1787098351.442180:0:16712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.442222:0:16712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.442231:0:16712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.442239:0:16712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7c00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:3.0:1787098351.442244:0:16712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.442254:0:16712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.442316:0:16712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.442326:0:16712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000632d587a/0xb1d871f9b0145d3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787098351.442452:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7207df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+14:2375:x1873908059991680:12345-192.168.204.51@tcp:4:dd.0 Request processed in 114886us (307318us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787098351.442464:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:3.0:1787098351.442508:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1787098351.442524:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+13:2375:x1873908059991936:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:3.0:1787098351.442564:0:16712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.442585:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098351.442590:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787098351.442598:0:16712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787098351.442612:0:16712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787098351.442763:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:1.0:1787098351.481697:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1787098351.481820:0:15173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1787098351.481827:0:15173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1787098351.481857:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.481873:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.481885:0:15173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.481894:0:15173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098351.481901:0:15173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.481937:0:15173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.481978:0:15173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.481988:0:15173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f26d20/0xb1d871f9b0145d45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098351.482116:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+11:2375:x1873908059991808:12345-192.168.204.51@tcp:4:dd.0 Request processed in 93471us (346947us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787098351.482128:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1787098351.482170:0:15173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1787098351.482185:0:15173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+10:2375:x1873908059992064:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:0.0:1787098351.482226:0:15173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.482241:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098351.482246:0:15173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098351.482254:0:15173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.482269:0:15173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787098351.525814:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1787098351.526478:0:16712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1787098351.526486:0:16712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1787098351.526506:0:16712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.526523:0:16712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.526532:0:16712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.526542:0:16712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d72421c7600 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098351.526548:0:16712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.526621:0:16712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.526653:0:16712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.526662:0:16712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eac037cd/0xb1d871f9b0145d4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098351.526793:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+10:2375:x1873908059991936:12345-192.168.204.51@tcp:4:dd.0 Request processed in 84269us (391613us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787098351.526822:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1787098351.526870:0:16712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1787098351.526885:0:16712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:2376:x1873908059992192:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:0.0:1787098351.526929:0:16712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.529534:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098351.529549:0:16712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787098351.529621:0:16712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.529647:0:16712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787098351.569667:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1787098351.570914:0:15173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1787098351.570926:0:15173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1787098351.570947:0:15173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.570965:0:15173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.570977:0:15173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.571003:0:15173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204e200 already unused, calling callback (ffffffffc1704010) 00010000:00010000:1.0:1787098351.571009:0:15173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.571019:0:15173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.571047:0:15173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787098351.571055:0:15173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af88b5b9/0xb1d871f9b0145d53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098351.572198:0:15173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+9:2375:x1873908059992064:12345-192.168.204.51@tcp:4:dd.0 Request processed in 90007us (437000us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787098351.572214:0:15173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000001:00080000:3.0:1787098351.644843:0:6727:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1787098351.645528:0:16712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.645549:0:16712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.645619:0:16712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.645650:0:16712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d724204ea00 already unused, calling callback (ffffffffc1704010) 00010000:00010000:0.0:1787098351.645656:0:16712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.645666:0:16712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.645692:0:16712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787098351.645700:0:16712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb3b346a/0xb1d871f9b0145d5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787098351.645848:0:16712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:85a9a2aa-4d4f-47f9-beda-b138dd8bb05c+5:2376:x1873908059992192:12345-192.168.204.51@tcp:4:dd.0 Request processed in 118951us (510634us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787098351.645861:0:16712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00010000:00010000:3.0:1787098352.399572:0:15853:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098352.786062:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787098352.786095:0:3312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077795840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787098352.786200:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098352.786321:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077795840 00000100:00100000:0.0:1787098352.786344:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077795840 00000100:00100000:0.0:1787098352.786420:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787098352.786433:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077795840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787098352.786488:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1787098352.786541:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1873908077795840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098352.786568:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787098352.786594:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787098352.786629:0:3312:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1787098352.786636:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7207df3800, transno 8589934595 00000004:00080000:0.0:1787098352.786655:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1787098352.786690:0:3312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1873908077795840:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787098353.417949:0:16750:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787098353.423614:0:14472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787098353.808385:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077796352:0@lo:400:kworker.0 00000100:00100000:0.0:1787098353.808476:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098353.808562:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787098353.808569:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc79daaf-8bf3-4a07-a406-566e9526a151:3311:1873908077795968:0@lo:400:kworker.0 00000100:00100000:0.0:1787098353.808604:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098353.808630:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077796480:0@lo:400:kworker.0 00000100:00100000:0.0:1787098353.808651:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098353.808684:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077795968 00000100:00100000:0.0:1787098353.808692:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077795968 00000100:00100000:0.0:1787098353.808737:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787098353.808748:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d723f21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3311:x1873908077795968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098353.808833:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7207df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077796096:0@lo:400:kworker.0 00000100:00100000:2.0:1787098353.809326:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077796352 00000100:00100000:2.0:1787098353.809332:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077796352 00000100:00100000:2.0:1787098353.809366:0:15191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077796480 00000100:00100000:2.0:1787098353.809370:0:15191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077796480 00000100:00100000:2.0:1787098353.809397:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787098353.809406:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077796352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787098353.809457:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1873908077796352:12345-0@lo:400:kworker.0 Request processed in 51us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098353.809464:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787098353.809485:0:15191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787098353.809485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787098353.809511:0:15191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7104f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077796480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098353.809513:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7104f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1873908077796608:0@lo:400:kworker.0 00000100:00100000:0.0:1787098353.809724:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d723f21b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc79daaf-8bf3-4a07-a406-566e9526a151+19:3311:x1873908077795968:12345-0@lo:400:kworker.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098353.809731:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1787098353.809768:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787098353.809778:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787098353.809820:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077796608 00000100:00100000:1.0:1787098353.809822:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787098353.809830:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d723ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077796224:0@lo:400:kworker.0 00000100:00100000:0.0:1787098353.809838:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077796608 00000100:00100000:0.0:1787098353.809865:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787098353.809872:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873908077796608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787098353.810276:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787098353.810320:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8d7227524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077796736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787098353.810382:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077796096 00000100:00100000:3.0:1787098353.810387:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077796096 00000100:00100000:3.0:1787098353.810417:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077796224 00000100:00100000:3.0:1787098353.810419:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077796224 00000100:00100000:3.0:1787098353.810444:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787098353.810452:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077796096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098353.810496:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077796096:12345-0@lo:400:kworker.0 Request processed in 46us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098353.810503:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787098353.810516:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787098353.810521:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077796224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787098353.810542:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077796224:12345-0@lo:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098353.810555:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787098353.810623:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787098353.810714:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dc79daaf-8bf3-4a07-a406-566e9526a151:3311:1873908077795968:0@lo:400:kworker.0 00000100:00100000:3.0:1787098353.810729:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1873908077796480:0@lo:400:kworker.0 00000100:00100000:3.0:1787098353.810739:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1873908077796352:0@lo:400:kworker.0 00000100:00100000:3.0:1787098353.810782:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873908077796736 00000100:00100000:3.0:1787098353.810785:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873908077796736 00000100:00100000:3.0:1787098353.810834:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787098353.810841:0:15172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7227525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077796736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787098353.810866:0:15172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787098353.810913:0:15172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873908077796736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787098353.810919:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787098353.811144:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7227524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873908077796608:12345-0@lo:400:kworker.0 Request processed in 1271us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787098353.811152:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787098353.811171:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787098353.811175:0:14479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787098353.811217:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7227524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077796736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787098353.811229:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7207df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077796096:0@lo:400:kworker.0 00000100:00100000:0.0:1787098353.811239:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d7104f90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1873908077796608:0@lo:400:kworker.0 00000100:00100000:0.0:1787098353.811260:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8d723ba42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1873908077796224:0@lo:400:kworker.0 00000100:00100000:2.0:1787098353.812230:0:15191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7104f92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1873908077796480:12345-0@lo:400:kworker.0 Request processed in 2715us (3571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787098353.812240:0:15191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000040:00080000:0.0:1787098354.063572:0:14517:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787098354.063581:0:14517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787098354.063614:0:14517:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787098354.063621:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787098354.449068:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29128 lines, 29128 kept, 0 dropped, 0 bad.